Skip to content

expr test#7258

Closed
onursatici wants to merge 1 commit intodevelopfrom
os/expr-hack
Closed

expr test#7258
onursatici wants to merge 1 commit intodevelopfrom
os/expr-hack

Conversation

@onursatici
Copy link
Copy Markdown
Contributor

@onursatici onursatici commented Apr 2, 2026

Summary

Closes: #000

Testing

@onursatici
expr test
31586f3 
Signed-off-by: Onur Satici <onur@spiraldb.com>
@onursatici onursatici added the action/benchmark Trigger full benchmarks to run on this PR label Apr 2, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 2, 2026
@joseph-isaacs joseph-isaacs added the do not merge Pull requests that are not intended to merge label Apr 2, 2026
@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented Apr 2, 2026

Merging this PR will degrade performance by 23.78%

❌ 26 regressed benchmarks
✅ 1096 untouched benchmarks
⏩ 1530 skipped benchmarks1

⚠️ Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ Simulation take_search[(0.005, 0.5)] 1.2 ms 1.5 ms -23.61%
❌ Simulation take_search[(0.005, 0.1)] 251.7 µs 324.6 µs -22.48%
❌ Simulation take_search[(0.1, 0.5)] 1.8 ms 2.2 ms -16.9%
❌ Simulation take_search[(0.1, 1.0)] 3.5 ms 4.3 ms -17.08%
❌ Simulation take_search[(0.005, 0.05)] 135.8 µs 172.4 µs -21.22%
❌ Simulation take_search[(0.01, 0.1)] 272.7 µs 345.6 µs -21.12%
❌ Simulation take_search[(0.1, 0.05)] 217 µs 253.6 µs -14.43%
❌ Simulation take_search_chunked[(0.005, 0.05)] 170.9 µs 202 µs -15.4%
❌ Simulation take_search_chunked[(0.005, 0.5)] 1.5 ms 1.8 ms -16.98%
❌ Simulation take_search[(0.1, 0.1)] 391.4 µs 464.4 µs -15.72%
❌ Simulation take_search[(0.01, 1.0)] 2.5 ms 3.3 ms -22.31%
❌ Simulation take_search[(0.01, 0.5)] 1.3 ms 1.6 ms -22.16%
❌ Simulation take_search[(0.005, 1.0)] 2.3 ms 3.1 ms -23.78%
❌ Simulation take_search[(0.01, 0.05)] 147.2 µs 183.8 µs -19.9%
❌ Simulation take_search_chunked[(0.01, 0.05)] 184 µs 215.1 µs -14.45%
❌ Simulation take_search_chunked[(0.01, 0.5)] 1.6 ms 1.9 ms -15.94%
❌ Simulation take_search_chunked[(0.005, 1.0)] 3 ms 3.6 ms -17.09%
❌ Simulation take_search_chunked[(0.1, 0.05)] 250.2 µs 281.3 µs -11.06%
❌ Simulation take_search_chunked[(0.01, 1.0)] 3.2 ms 3.9 ms -16.04%
❌ Simulation take_search_chunked[(0.005, 0.1)] 320 µs 382 µs -16.24%
... ... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.

Comparing os/expr-hack (31586f3) with develop (13937c0)

Open in CodSpeed

Footnotes

  1. 1530 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 2, 2026 •
edited
Loading

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 31586f3 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 2, 2026

Benchmarks: PolarSignals Profiling

Vortex (geomean): 0.996x ➖

datafusion / vortex-file-compressed (0.996x ➖, 0↑ 0↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 123932790 124725322 0.99
polarsignals_q01/datafusion:vortex-file-compressed 373510967 383877775 0.97
polarsignals_q02/datafusion:vortex-file-compressed 22286188 23669048 0.94
polarsignals_q03/datafusion:vortex-file-compressed 381028217 376883204 1.01
polarsignals_q04/datafusion:vortex-file-compressed 10650950 10844337 0.98
polarsignals_q05/datafusion:vortex-file-compressed 14937585 14716356 1.02
polarsignals_q06/datafusion:vortex-file-compressed 18252488 19021081 0.96
polarsignals_q07/datafusion:vortex-file-compressed 13635277 12600740 1.08
polarsignals_q08/datafusion:vortex-file-compressed 464090925 471181807 0.98
polarsignals_q09/datafusion:vortex-file-compressed 10688874 10421035 1.03

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 2, 2026

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -1.4%
Vortex (geomean): 0.998x ➖
Parquet (geomean): 1.013x ➖
Shifts: Parquet (control) +1.3% · Median polish -0.3%

datafusion / vortex-file-compressed (0.991x ➖, 0↑ 0↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 50819562 50463344 1.01
tpch_q02/datafusion:vortex-file-compressed 32779496 32085544 1.02
tpch_q03/datafusion:vortex-file-compressed 27024754 26587481 1.02
tpch_q04/datafusion:vortex-file-compressed 18087925 18004922 1.00
tpch_q05/datafusion:vortex-file-compressed 54070667 53891790 1.00
tpch_q06/datafusion:vortex-file-compressed 10577149 10794482 0.98
tpch_q07/datafusion:vortex-file-compressed 62650639 65154440 0.96
tpch_q08/datafusion:vortex-file-compressed 44623153 45391968 0.98
tpch_q09/datafusion:vortex-file-compressed 54490866 55275427 0.99
tpch_q10/datafusion:vortex-file-compressed 44414431 43205366 1.03
tpch_q11/datafusion:vortex-file-compressed 18190463 17776981 1.02
tpch_q12/datafusion:vortex-file-compressed 22139975 23030856 0.96
tpch_q13/datafusion:vortex-file-compressed 27180657 27044199 1.01
tpch_q14/datafusion:vortex-file-compressed 15998451 16033486 1.00
tpch_q15/datafusion:vortex-file-compressed 23417490 24875308 0.94
tpch_q16/datafusion:vortex-file-compressed 24374690 24421332 1.00
tpch_q17/datafusion:vortex-file-compressed 63227905 64437299 0.98
tpch_q18/datafusion:vortex-file-compressed 78028997 78313026 1.00
tpch_q19/datafusion:vortex-file-compressed 22347718 22557394 0.99
tpch_q20/datafusion:vortex-file-compressed 32264899 32067952 1.01
tpch_q21/datafusion:vortex-file-compressed 73216498 74284595 0.99
tpch_q22/datafusion:vortex-file-compressed 15791093 16842155 0.94
datafusion / vortex-compact (0.994x ➖, 0↑ 0↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 56304968 57757256 0.97
tpch_q02/datafusion:vortex-compact 36427103 36396993 1.00
tpch_q03/datafusion:vortex-compact 31084388 30573744 1.02
tpch_q04/datafusion:vortex-compact 23892805 23005043 1.04
tpch_q05/datafusion:vortex-compact 56723823 55891228 1.01
tpch_q06/datafusion:vortex-compact 12970043 13628561 0.95
tpch_q07/datafusion:vortex-compact 70256142 68158809 1.03
tpch_q08/datafusion:vortex-compact 51116318 50359323 1.02
tpch_q09/datafusion:vortex-compact 61060912 61134381 1.00
tpch_q10/datafusion:vortex-compact 53070425 54039763 0.98
tpch_q11/datafusion:vortex-compact 20512089 20169435 1.02
tpch_q12/datafusion:vortex-compact 33550757 34048507 0.99
tpch_q13/datafusion:vortex-compact 36749382 37654451 0.98
tpch_q14/datafusion:vortex-compact 20554718 21091443 0.97
tpch_q15/datafusion:vortex-compact 33668990 35151905 0.96
tpch_q16/datafusion:vortex-compact 29364528 29536511 0.99
tpch_q17/datafusion:vortex-compact 68410589 69787509 0.98
tpch_q18/datafusion:vortex-compact 85204081 88852622 0.96
tpch_q19/datafusion:vortex-compact 34353056 33226146 1.03
tpch_q20/datafusion:vortex-compact 38576856 38627558 1.00
tpch_q21/datafusion:vortex-compact 87076394 87376269 1.00
tpch_q22/datafusion:vortex-compact 17034405 17291975 0.99
datafusion / parquet (1.012x ➖, 0↑ 2↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 124494764 93915661 1.33
tpch_q02/datafusion:parquet 68518620 69842575 0.98
tpch_q03/datafusion:parquet 83023329 78853734 1.05
tpch_q04/datafusion:parquet 49008137 48156124 1.02
tpch_q05/datafusion:parquet 102651257 99321740 1.03
tpch_q06/datafusion:parquet 38991596 39975577 0.98
tpch_q07/datafusion:parquet 112068012 113301450 0.99
tpch_q08/datafusion:parquet 105613445 97669294 1.08
tpch_q09/datafusion:parquet 130248662 134670424 0.97
tpch_q10/datafusion:parquet 119245560 122524217 0.97
tpch_q11/datafusion:parquet 47001436 48493992 0.97
tpch_q12/datafusion:parquet 🚨 95421003 80189386 1.19
tpch_q13/datafusion:parquet 203202640 206144481 0.99
tpch_q14/datafusion:parquet 49118417 52701999 0.93
tpch_q15/datafusion:parquet 67643059 64816155 1.04
tpch_q16/datafusion:parquet 50764797 50871648 1.00
tpch_q17/datafusion:parquet 127027483 135032127 0.94
tpch_q18/datafusion:parquet 170102103 167153002 1.02
tpch_q19/datafusion:parquet 86208488 91617819 0.94
tpch_q20/datafusion:parquet 75806647 79050208 0.96
tpch_q21/datafusion:parquet 147060437 146983390 1.00
tpch_q22/datafusion:parquet 33944230 35061492 0.97
datafusion / arrow (0.997x ➖, 1↑ 0↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 51630748 57239116 0.90
tpch_q02/datafusion:arrow 21458144 22314825 0.96
tpch_q03/datafusion:arrow 34545030 33901498 1.02
tpch_q04/datafusion:arrow 28333401 27376561 1.03
tpch_q05/datafusion:arrow 78059510 77702397 1.00
tpch_q06/datafusion:arrow 20399830 20620507 0.99
tpch_q07/datafusion:arrow 111082835 112601839 0.99
tpch_q08/datafusion:arrow 45557710 47492425 0.96
tpch_q09/datafusion:arrow 72140434 72572414 0.99
tpch_q10/datafusion:arrow 54713335 51188079 1.07
tpch_q11/datafusion:arrow 12401381 11305289 1.10
tpch_q12/datafusion:arrow 57262173 54912134 1.04
tpch_q13/datafusion:arrow 50002749 51193383 0.98
tpch_q14/datafusion:arrow 23523547 22787695 1.03
tpch_q15/datafusion:arrow 44610209 44753177 1.00
tpch_q16/datafusion:arrow 21138634 20795719 1.02
tpch_q17/datafusion:arrow 70408925 72153939 0.98
tpch_q18/datafusion:arrow 144620095 144385595 1.00
tpch_q19/datafusion:arrow 🚀 41249028 47516389 0.87
tpch_q20/datafusion:arrow 39752923 39093312 1.02
tpch_q21/datafusion:arrow 158453626 152395419 1.04
tpch_q22/datafusion:arrow 19340508 19773939 0.98
duckdb / vortex-file-compressed (1.000x ➖, 0↑ 0↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 33557967 33501797 1.00
tpch_q02/duckdb:vortex-file-compressed 28220248 27471538 1.03
tpch_q03/duckdb:vortex-file-compressed 27682651 28461487 0.97
tpch_q04/duckdb:vortex-file-compressed 29541956 28508920 1.04
tpch_q05/duckdb:vortex-file-compressed 33364769 34105751 0.98
tpch_q06/duckdb:vortex-file-compressed 10996470 11243860 0.98
tpch_q07/duckdb:vortex-file-compressed 37372717 36322072 1.03
tpch_q08/duckdb:vortex-file-compressed 40163308 38347950 1.05
tpch_q09/duckdb:vortex-file-compressed 79277077 79540415 1.00
tpch_q10/duckdb:vortex-file-compressed 36551659 36088588 1.01
tpch_q11/duckdb:vortex-file-compressed 16247044 16816734 0.97
tpch_q12/duckdb:vortex-file-compressed 22175667 23146080 0.96
tpch_q13/duckdb:vortex-file-compressed 37480638 37262852 1.01
tpch_q14/duckdb:vortex-file-compressed 21985096 21371159 1.03
tpch_q15/duckdb:vortex-file-compressed 16269704 16234086 1.00
tpch_q16/duckdb:vortex-file-compressed 30596957 29502980 1.04
tpch_q17/duckdb:vortex-file-compressed 24752209 25728586 0.96
tpch_q18/duckdb:vortex-file-compressed 45721742 48073085 0.95
tpch_q19/duckdb:vortex-file-compressed 31765903 31762574 1.00
tpch_q20/duckdb:vortex-file-compressed 34976712 34009832 1.03
tpch_q21/duckdb:vortex-file-compressed 99438719 102605817 0.97
tpch_q22/duckdb:vortex-file-compressed 18235942 17740393 1.03
duckdb / vortex-compact (1.006x ➖, 0↑ 0↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 39355273 40235689 0.98
tpch_q02/duckdb:vortex-compact 38721869 37135639 1.04
tpch_q03/duckdb:vortex-compact 31965435 32606930 0.98
tpch_q04/duckdb:vortex-compact 34115167 33937583 1.01
tpch_q05/duckdb:vortex-compact 36736751 36798704 1.00
tpch_q06/duckdb:vortex-compact 13906028 14211488 0.98
tpch_q07/duckdb:vortex-compact 42992817 42128494 1.02
tpch_q08/duckdb:vortex-compact 46023652 44719700 1.03
tpch_q09/duckdb:vortex-compact 87579941 89970367 0.97
tpch_q10/duckdb:vortex-compact 41318611 40467255 1.02
tpch_q11/duckdb:vortex-compact 21363919 19721239 1.08
tpch_q12/duckdb:vortex-compact 39051420 37440712 1.04
tpch_q13/duckdb:vortex-compact 46611972 47662823 0.98
tpch_q14/duckdb:vortex-compact 29853957 30089421 0.99
tpch_q15/duckdb:vortex-compact 19385575 19305368 1.00
tpch_q16/duckdb:vortex-compact 36790995 36739432 1.00
tpch_q17/duckdb:vortex-compact 31838757 31100689 1.02
tpch_q18/duckdb:vortex-compact 49226849 49788488 0.99
tpch_q19/duckdb:vortex-compact 37172906 36019307 1.03
tpch_q20/duckdb:vortex-compact 43549156 43432777 1.00
tpch_q21/duckdb:vortex-compact 109784535 109397623 1.00
tpch_q22/duckdb:vortex-compact 20538370 21442738 0.96
duckdb / parquet (1.013x ➖, 2↑ 4↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 🚨 104244828 85765306 1.22
tpch_q02/duckdb:parquet 39079002 40069175 0.98
tpch_q03/duckdb:parquet 🚨 82181931 69930366 1.18
tpch_q04/duckdb:parquet 🚀 47810994 54878559 0.87
tpch_q05/duckdb:parquet 66744037 67815463 0.98
tpch_q06/duckdb:parquet 20825763 20377849 1.02
tpch_q07/duckdb:parquet 66429569 69462211 0.96
tpch_q08/duckdb:parquet 79829574 82783518 0.96
tpch_q09/duckdb:parquet 156993679 157621353 1.00
tpch_q10/duckdb:parquet 124326929 132657584 0.94
tpch_q11/duckdb:parquet 22123641 21967995 1.01
tpch_q12/duckdb:parquet 🚀 44794759 57679311 0.78
tpch_q13/duckdb:parquet 259506380 277957461 0.93
tpch_q14/duckdb:parquet 🚨 60085166 49591121 1.21
tpch_q15/duckdb:parquet 24518030 24505669 1.00
tpch_q16/duckdb:parquet 54671419 55272093 0.99
tpch_q17/duckdb:parquet 52584887 50609399 1.04
tpch_q18/duckdb:parquet 125908792 114648227 1.10
tpch_q19/duckdb:parquet 68749151 68042176 1.01
tpch_q20/duckdb:parquet 🚨 74697320 62370605 1.20
tpch_q21/duckdb:parquet 179537316 173072677 1.04
tpch_q22/duckdb:parquet 52792785 52072065 1.01
duckdb / duckdb (1.001x ➖, 0↑ 1↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 16691463 16053396 1.04
tpch_q02/duckdb:duckdb 12062605 11400284 1.06
tpch_q03/duckdb:duckdb 19968511 19349329 1.03
tpch_q04/duckdb:duckdb 19402171 18660207 1.04
tpch_q05/duckdb:duckdb 19107873 20855302 0.92
tpch_q06/duckdb:duckdb 5214920 5222995 1.00
tpch_q07/duckdb:duckdb 22239976 22514164 0.99
tpch_q08/duckdb:duckdb 20066082 21324941 0.94
tpch_q09/duckdb:duckdb 53325152 54582200 0.98
tpch_q10/duckdb:duckdb 41923051 43723817 0.96
tpch_q11/duckdb:duckdb 5593144 5834408 0.96
tpch_q12/duckdb:duckdb 13695240 13862504 0.99
tpch_q13/duckdb:duckdb 🚨 42267980 36359475 1.16
tpch_q14/duckdb:duckdb 17531170 17659509 0.99
tpch_q15/duckdb:duckdb 12206101 11441850 1.07
tpch_q16/duckdb:duckdb 22647704 23949542 0.95
tpch_q17/duckdb:duckdb 13586267 13555925 1.00
tpch_q18/duckdb:duckdb 38416240 38897257 0.99
tpch_q19/duckdb:duckdb 28515418 28060749 1.02
tpch_q20/duckdb:duckdb 23833089 23745678 1.00
tpch_q21/duckdb:duckdb 55777387 56658197 0.98
tpch_q22/duckdb:duckdb 24053502 24365614 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -9.8% +26.9% -28.9% +27.9% ✅ faster
1 datafusion:vortex-compact -2.5% +26.9% -23.2% +25.1% ✅ faster
1 datafusion:vortex-file-compressed +0.7% +26.9% -20.7% +27.4% ➖ noise
1 duckdb:duckdb +4.0% +26.9% -18.1% +25.0% ➖ noise
1 duckdb:vortex-compact -2.2% +26.9% -22.9% +24.1% ✅ faster
1 duckdb:vortex-file-compressed +0.2% +26.9% -21.1% +24.3% ✅ faster
2 datafusion:arrow -3.8% -2.2% -1.7% +18.3% ➖ noise
2 datafusion:vortex-compact +0.1% -2.2% +2.3% +18.3% ➖ noise
2 datafusion:vortex-file-compressed +2.2% -2.2% +4.4% +18.3% ➖ noise
2 duckdb:duckdb +5.8% -2.2% +8.2% +19.4% ➖ noise
2 duckdb:vortex-compact +4.3% -2.2% +6.6% +18.3% ➖ noise
2 duckdb:vortex-file-compressed +2.7% -2.2% +5.0% +18.3% ➖ noise
3 datafusion:arrow +1.9% +11.2% -8.4% +18.3% ➖ noise
3 datafusion:vortex-compact +1.7% +11.2% -8.6% +18.3% ➖ noise
3 datafusion:vortex-file-compressed +1.6% +11.2% -8.6% +18.3% ➖ noise
3 duckdb:duckdb +3.2% +11.2% -7.2% +18.3% ➖ noise
3 duckdb:vortex-compact -2.0% +11.2% -11.9% +18.3% ➖ noise
3 duckdb:vortex-file-compressed -2.7% +11.2% -12.6% +18.3% ➖ noise
4 datafusion:arrow +3.5% -5.8% +9.9% +18.3% ➖ noise
4 datafusion:vortex-compact +3.9% -5.8% +10.3% +18.3% ➖ noise
4 datafusion:vortex-file-compressed +0.5% -5.8% +6.7% +18.3% ➖ noise
4 duckdb:duckdb +4.0% -5.8% +10.4% +18.3% ➖ noise
4 duckdb:vortex-compact +0.5% -5.8% +6.8% +18.3% ➖ noise
4 duckdb:vortex-file-compressed +3.6% -5.8% +10.0% +18.3% ➖ noise
5 datafusion:arrow +0.5% +0.9% -0.4% +18.3% ➖ noise
5 datafusion:vortex-compact +1.5% +0.9% +0.6% +18.3% ➖ noise
5 datafusion:vortex-file-compressed +0.3% +0.9% -0.5% +18.3% ➖ noise
5 duckdb:duckdb -8.4% +0.9% -9.2% +18.3% ➖ noise
5 duckdb:vortex-compact -0.2% +0.9% -1.0% +18.3% ➖ noise
5 duckdb:vortex-file-compressed -2.2% +0.9% -3.0% +18.3% ➖ noise
6 datafusion:arrow -1.1% -0.2% -0.9% +18.3% ➖ noise
6 datafusion:vortex-compact -4.8% -0.2% -4.7% +18.3% ➖ noise
6 datafusion:vortex-file-compressed -2.0% -0.2% -1.9% +20.8% ➖ noise
6 duckdb:duckdb -0.2% -0.2% +0.0% +20.1% ➖ noise
6 duckdb:vortex-compact -2.1% -0.2% -2.0% +22.9% ➖ noise
6 duckdb:vortex-file-compressed -2.2% -0.2% -2.0% +18.3% ➖ noise
7 datafusion:arrow -1.3% -2.7% +1.4% +18.3% ➖ noise
7 datafusion:vortex-compact +3.1% -2.7% +6.0% +18.3% ➖ noise
7 datafusion:vortex-file-compressed -3.8% -2.7% -1.1% +18.3% ➖ noise
7 duckdb:duckdb -1.2% -2.7% +1.6% +18.3% ➖ noise
7 duckdb:vortex-compact +2.1% -2.7% +4.9% +18.3% ➖ noise
7 duckdb:vortex-file-compressed +2.9% -2.7% +5.8% +18.3% ➖ noise
8 datafusion:arrow -4.1% +2.1% -6.1% +18.3% ➖ noise
8 datafusion:vortex-compact +1.5% +2.1% -0.6% +18.3% ➖ noise
8 datafusion:vortex-file-compressed -1.7% +2.1% -3.7% +18.3% ➖ noise
8 duckdb:duckdb -5.9% +2.1% -7.9% +18.3% ➖ noise
8 duckdb:vortex-compact +2.9% +2.1% +0.8% +18.3% ➖ noise
8 duckdb:vortex-file-compressed +4.7% +2.1% +2.6% +18.3% ➖ noise
9 datafusion:arrow -0.6% -1.9% +1.3% +18.3% ➖ noise
9 datafusion:vortex-compact -0.1% -1.9% +1.8% +18.3% ➖ noise
9 datafusion:vortex-file-compressed -1.4% -1.9% +0.4% +18.3% ➖ noise
9 duckdb:duckdb -2.3% -1.9% -0.5% +18.3% ➖ noise
9 duckdb:vortex-compact -2.7% -1.9% -0.8% +18.3% ➖ noise
9 duckdb:vortex-file-compressed -0.3% -1.9% +1.5% +18.3% ➖ noise
10 datafusion:arrow +6.9% -4.5% +11.9% +18.3% ➖ noise
10 datafusion:vortex-compact -1.8% -4.5% +2.8% +18.3% ➖ noise
10 datafusion:vortex-file-compressed +2.8% -4.5% +7.6% +18.3% ➖ noise
10 duckdb:duckdb -4.1% -4.5% +0.4% +18.3% ➖ noise
10 duckdb:vortex-compact +2.1% -4.5% +6.9% +18.3% ➖ noise
10 duckdb:vortex-file-compressed +1.3% -4.5% +6.0% +18.3% ➖ noise
11 datafusion:arrow +9.7% -1.2% +11.0% +18.3% ➖ noise
11 datafusion:vortex-compact +1.7% -1.2% +2.9% +38.0% ➖ noise
11 datafusion:vortex-file-compressed +2.3% -1.2% +3.6% +18.3% ➖ noise
11 duckdb:duckdb -4.1% -1.2% -3.0% +18.3% ➖ noise
11 duckdb:vortex-compact +8.3% -1.2% +9.6% +18.3% ➖ noise
11 duckdb:vortex-file-compressed -3.4% -1.2% -2.2% +18.3% ➖ noise
12 datafusion:arrow +4.3% -3.9% +8.5% +18.3% ➖ noise
12 datafusion:vortex-compact -1.5% -3.9% +2.5% +18.3% ➖ noise
12 datafusion:vortex-file-compressed -3.9% -3.9% -0.0% +18.3% ➖ noise
12 duckdb:duckdb -1.2% -3.9% +2.8% +18.3% ➖ noise
12 duckdb:vortex-compact +4.3% -3.9% +8.5% +18.3% ➖ noise
12 duckdb:vortex-file-compressed -4.2% -3.9% -0.3% +18.3% ➖ noise
13 datafusion:arrow -2.3% -4.1% +1.8% +18.3% ➖ noise
13 datafusion:vortex-compact -2.4% -4.1% +1.7% +18.3% ➖ noise
13 datafusion:vortex-file-compressed +0.5% -4.1% +4.8% +18.3% ➖ noise
13 duckdb:duckdb +16.3% -4.1% +21.2% +18.3% 🚨 regression
13 duckdb:vortex-compact -2.2% -4.1% +1.9% +18.3% ➖ noise
13 duckdb:vortex-file-compressed +0.6% -4.1% +4.8% +18.3% ➖ noise
14 datafusion:arrow +3.2% +6.3% -2.9% +18.3% ➖ noise
14 datafusion:vortex-compact -2.5% +6.3% -8.3% +18.3% ➖ noise
14 datafusion:vortex-file-compressed -0.2% +6.3% -6.1% +18.3% ➖ noise
14 duckdb:duckdb -0.7% +6.3% -6.6% +22.7% ➖ noise
14 duckdb:vortex-compact -0.8% +6.3% -6.6% +18.3% ➖ noise
14 duckdb:vortex-file-compressed +2.9% +6.3% -3.2% +18.3% ➖ noise
15 datafusion:arrow -0.3% +2.2% -2.4% +18.3% ➖ noise
15 datafusion:vortex-compact -4.2% +2.2% -6.3% +18.3% ➖ noise
15 datafusion:vortex-file-compressed -5.9% +2.2% -7.9% +18.3% ➖ noise
15 duckdb:duckdb +6.7% +2.2% +4.4% +19.0% ➖ noise
15 duckdb:vortex-compact +0.4% +2.2% -1.7% +18.3% ➖ noise
15 duckdb:vortex-file-compressed +0.2% +2.2% -1.9% +18.3% ➖ noise
16 datafusion:arrow +1.6% -0.6% +2.3% +18.3% ➖ noise
16 datafusion:vortex-compact -0.6% -0.6% +0.1% +18.3% ➖ noise
16 datafusion:vortex-file-compressed -0.2% -0.6% +0.5% +18.3% ➖ noise
16 duckdb:duckdb -5.4% -0.6% -4.8% +18.3% ➖ noise
16 duckdb:vortex-compact +0.1% -0.6% +0.8% +18.3% ➖ noise
16 duckdb:vortex-file-compressed +3.7% -0.6% +4.4% +18.3% ➖ noise
17 datafusion:arrow -2.4% -1.1% -1.3% +18.3% ➖ noise
17 datafusion:vortex-compact -2.0% -1.1% -0.8% +18.3% ➖ noise
17 datafusion:vortex-file-compressed -1.9% -1.1% -0.8% +22.2% ➖ noise
17 duckdb:duckdb +0.2% -1.1% +1.4% +18.5% ➖ noise
17 duckdb:vortex-compact +2.4% -1.1% +3.5% +19.4% ➖ noise
17 duckdb:vortex-file-compressed -3.8% -1.1% -2.7% +21.1% ➖ noise
18 datafusion:arrow +0.2% +5.7% -5.3% +18.3% ➖ noise
18 datafusion:vortex-compact -4.1% +5.7% -9.3% +18.3% ➖ noise
18 datafusion:vortex-file-compressed -0.4% +5.7% -5.8% +18.3% ➖ noise
18 duckdb:duckdb -1.2% +5.7% -6.6% +18.3% ➖ noise
18 duckdb:vortex-compact -1.1% +5.7% -6.5% +18.3% ➖ noise
18 duckdb:vortex-file-compressed -4.9% +5.7% -10.0% +18.3% ➖ noise
19 datafusion:arrow -13.2% -2.5% -11.0% +18.3% ➖ noise
19 datafusion:vortex-compact +3.4% -2.5% +6.0% +18.3% ➖ noise
19 datafusion:vortex-file-compressed -0.9% -2.5% +1.6% +18.3% ➖ noise
19 duckdb:duckdb +1.6% -2.5% +4.2% +18.3% ➖ noise
19 duckdb:vortex-compact +3.2% -2.5% +5.8% +18.3% ➖ noise
19 duckdb:vortex-file-compressed +0.0% -2.5% +2.6% +18.3% ➖ noise
20 datafusion:arrow +1.7% +7.2% -5.1% +26.4% ➖ noise
20 datafusion:vortex-compact -0.1% +7.2% -6.8% +18.3% ➖ noise
20 datafusion:vortex-file-compressed +0.6% +7.2% -6.1% +18.3% ➖ noise
20 duckdb:duckdb +0.4% +7.2% -6.3% +18.3% ➖ noise
20 duckdb:vortex-compact +0.3% +7.2% -6.4% +18.3% ➖ noise
20 duckdb:vortex-file-compressed +2.8% +7.2% -4.0% +18.3% ➖ noise
21 datafusion:arrow +4.0% +1.9% +2.1% +18.3% ➖ noise
21 datafusion:vortex-compact -0.3% +1.9% -2.2% +18.3% ➖ noise
21 datafusion:vortex-file-compressed -1.4% +1.9% -3.3% +18.3% ➖ noise
21 duckdb:duckdb -1.6% +1.9% -3.4% +18.3% ➖ noise
21 duckdb:vortex-compact +0.4% +1.9% -1.5% +18.3% ➖ noise
21 duckdb:vortex-file-compressed -3.1% +1.9% -4.9% +18.3% ➖ noise
22 datafusion:arrow -2.2% -0.9% -1.3% +18.3% ➖ noise
22 datafusion:vortex-compact -1.5% -0.9% -0.6% +18.3% ➖ noise
22 datafusion:vortex-file-compressed -6.2% -0.9% -5.4% +18.3% ➖ noise
22 duckdb:duckdb -1.3% -0.9% -0.4% +18.3% ➖ noise
22 duckdb:vortex-compact -4.2% -0.9% -3.3% +18.3% ➖ noise
22 duckdb:vortex-file-compressed +2.8% -0.9% +3.8% +18.3% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 2, 2026

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.6%
Vortex (geomean): 0.955x ➖
Parquet (geomean): 0.961x ➖
Shifts: Parquet (control) -3.9% · Median polish -4.3%

datafusion / vortex-file-compressed (0.946x ➖, 1↑ 0↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 5177626 5444826 0.95
fineweb_q01/datafusion:vortex-file-compressed 🚀 26291465 31385070 0.84
fineweb_q02/datafusion:vortex-file-compressed 27548973 29277488 0.94
fineweb_q03/datafusion:vortex-file-compressed 78131454 78716921 0.99
fineweb_q04/datafusion:vortex-file-compressed 241421707 260783834 0.93
fineweb_q05/datafusion:vortex-file-compressed 231909481 229308574 1.01
fineweb_q06/datafusion:vortex-file-compressed 67249618 66535728 1.01
fineweb_q07/datafusion:vortex-file-compressed 63594343 70048173 0.91
fineweb_q08/datafusion:vortex-file-compressed 27675965 29143325 0.95
datafusion / vortex-compact (0.946x ➖, 1↑ 0↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 5097409 5355240 0.95
fineweb_q01/datafusion:vortex-compact 162361681 166537221 0.97
fineweb_q02/datafusion:vortex-compact 161425483 169169047 0.95
fineweb_q03/datafusion:vortex-compact 1442456021 1502001664 0.96
fineweb_q04/datafusion:vortex-compact 1556017781 1618407334 0.96
fineweb_q05/datafusion:vortex-compact 1222067601 1312807946 0.93
fineweb_q06/datafusion:vortex-compact 693077863 723952265 0.96
fineweb_q07/datafusion:vortex-compact 726037845 749141059 0.97
fineweb_q08/datafusion:vortex-compact 🚀 21706147 25246709 0.86
datafusion / parquet (0.960x ➖, 0↑ 0↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 7352685 7155984 1.03
fineweb_q01/datafusion:parquet 265062295 282533941 0.94
fineweb_q02/datafusion:parquet 267770643 281567286 0.95
fineweb_q03/datafusion:parquet 270798031 280023174 0.97
fineweb_q04/datafusion:parquet 283704868 296959578 0.96
fineweb_q05/datafusion:parquet 279405754 290382283 0.96
fineweb_q06/datafusion:parquet 268771173 292011180 0.92
fineweb_q07/datafusion:parquet 266201666 278430965 0.96
fineweb_q08/datafusion:parquet 264760038 273803007 0.97
duckdb / vortex-file-compressed (0.983x ➖, 1↑ 1↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3297125 3328085 0.99
fineweb_q01/duckdb:vortex-file-compressed 27646465 29527117 0.94
fineweb_q02/duckdb:vortex-file-compressed 26186074 25694893 1.02
fineweb_q03/duckdb:vortex-file-compressed 🚨 156109114 135074821 1.16
fineweb_q04/duckdb:vortex-file-compressed 228676824 234622704 0.97
fineweb_q05/duckdb:vortex-file-compressed 218693038 219229441 1.00
fineweb_q06/duckdb:vortex-file-compressed 67865930 69972785 0.97
fineweb_q07/duckdb:vortex-file-compressed 🚀 65208034 73069033 0.89
fineweb_q08/duckdb:vortex-file-compressed 24944283 26859579 0.93
duckdb / vortex-compact (0.945x ➖, 1↑ 0↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 3928343 4290227 0.92
fineweb_q01/duckdb:vortex-compact 111238212 111751935 1.00
fineweb_q02/duckdb:vortex-compact 110712859 117315653 0.94
fineweb_q03/duckdb:vortex-compact 842347629 889663678 0.95
fineweb_q04/duckdb:vortex-compact 907846258 939805057 0.97
fineweb_q05/duckdb:vortex-compact 815154925 833164282 0.98
fineweb_q06/duckdb:vortex-compact 459400919 479998838 0.96
fineweb_q07/duckdb:vortex-compact 472876399 490207835 0.96
fineweb_q08/duckdb:vortex-compact 🚀 19992068 23557759 0.85
duckdb / parquet (0.961x ➖, 0↑ 0↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 36165662 39489778 0.92
fineweb_q01/duckdb:parquet 92714886 96727690 0.96
fineweb_q02/duckdb:parquet 95121017 99630734 0.95
fineweb_q03/duckdb:parquet 303880959 315126858 0.96
fineweb_q04/duckdb:parquet 437959869 445564252 0.98
fineweb_q05/duckdb:parquet 407248147 414333624 0.98
fineweb_q06/duckdb:parquet 197584622 202617531 0.98
fineweb_q07/duckdb:parquet 209205453 213883428 0.98
fineweb_q08/duckdb:parquet 56726720 60483299 0.94
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -4.8% -3.0% -1.9% +36.0% ➖ noise
0 datafusion:vortex-file-compressed -4.9% -3.0% -2.0% +51.8% ➖ noise
0 duckdb:vortex-compact -8.4% -3.0% -5.6% +28.7% ➖ noise
0 duckdb:vortex-file-compressed -0.9% -3.0% +2.1% +43.9% ➖ noise
1 datafusion:vortex-compact -2.5% -5.2% +2.8% +10.0% ➖ noise
1 datafusion:vortex-file-compressed -16.2% -5.2% -11.7% +15.5% ➖ noise
1 duckdb:vortex-compact -0.5% -5.2% +5.0% +16.3% ➖ noise
1 duckdb:vortex-file-compressed -6.4% -5.2% -1.3% +32.4% ➖ noise
2 datafusion:vortex-compact -4.6% -4.7% +0.1% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -5.9% -4.7% -1.2% +21.0% ➖ noise
2 duckdb:vortex-compact -5.6% -4.7% -1.0% +19.1% ➖ noise
2 duckdb:vortex-file-compressed +1.9% -4.7% +7.0% +10.9% ➖ noise
3 datafusion:vortex-compact -4.0% -3.4% -0.6% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -0.7% -3.4% +2.8% +23.4% ➖ noise
3 duckdb:vortex-compact -5.3% -3.4% -2.0% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +15.6% -3.4% +19.7% +32.8% ➖ noise
4 datafusion:vortex-compact -3.9% -3.1% -0.8% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -7.4% -3.1% -4.5% +14.5% ➖ noise
4 duckdb:vortex-compact -3.4% -3.1% -0.3% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -2.5% -3.1% +0.6% +10.0% ➖ noise
5 datafusion:vortex-compact -6.9% -2.8% -4.3% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +1.1% -2.8% +4.0% +10.0% ➖ noise
5 duckdb:vortex-compact -2.2% -2.8% +0.6% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -0.2% -2.8% +2.6% +10.0% ➖ noise
6 datafusion:vortex-compact -4.3% -5.3% +1.1% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +1.1% -5.3% +6.7% +10.0% ➖ noise
6 duckdb:vortex-compact -4.3% -5.3% +1.0% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -3.0% -5.3% +2.4% +10.2% ➖ noise
7 datafusion:vortex-compact -3.1% -3.3% +0.2% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -9.2% -3.3% -6.1% +11.2% ➖ noise
7 duckdb:vortex-compact -3.5% -3.3% -0.2% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -10.8% -3.3% -7.7% +16.2% ➖ noise
8 datafusion:vortex-compact -14.0% -4.8% -9.7% +19.9% ➖ noise
8 datafusion:vortex-file-compressed -5.0% -4.8% -0.3% +25.0% ➖ noise
8 duckdb:vortex-compact -15.1% -4.8% -10.9% +22.4% ➖ noise
8 duckdb:vortex-file-compressed -7.1% -4.8% -2.5% +18.6% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 2, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.8%
Vortex (geomean): 1.023x ➖
Parquet (geomean): 1.019x ➖
Shifts: Parquet (control) +1.9% · Median polish +2.7%

datafusion / vortex-file-compressed (1.000x ➖, 0↑ 1↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 30004803 29514632 1.02
tpcds_q02/datafusion:vortex-file-compressed 54342314 56265483 0.97
tpcds_q03/datafusion:vortex-file-compressed 21766361 21589800 1.01
tpcds_q04/datafusion:vortex-file-compressed 302042627 313458104 0.96
tpcds_q05/datafusion:vortex-file-compressed 54770497 57903495 0.95
tpcds_q06/datafusion:vortex-file-compressed 53660304 54354702 0.99
tpcds_q07/datafusion:vortex-file-compressed 51919282 55506733 0.94
tpcds_q08/datafusion:vortex-file-compressed 39780254 40149481 0.99
tpcds_q09/datafusion:vortex-file-compressed 56122066 57323224 0.98
tpcds_q10/datafusion:vortex-file-compressed 48625149 50146052 0.97
tpcds_q11/datafusion:vortex-file-compressed 173782085 178783411 0.97
tpcds_q12/datafusion:vortex-file-compressed 23784199 24295191 0.98
tpcds_q13/datafusion:vortex-file-compressed 62662510 66362148 0.94
tpcds_q14/datafusion:vortex-file-compressed 210531353 218728365 0.96
tpcds_q15/datafusion:vortex-file-compressed 36415249 36919416 0.99
tpcds_q16/datafusion:vortex-file-compressed 30449853 29749063 1.02
tpcds_q17/datafusion:vortex-file-compressed 71216653 72138836 0.99
tpcds_q18/datafusion:vortex-file-compressed 81486414 83459331 0.98
tpcds_q19/datafusion:vortex-file-compressed 32035486 33517516 0.96
tpcds_q20/datafusion:vortex-file-compressed 27041330 26008755 1.04
tpcds_q21/datafusion:vortex-file-compressed 141782681 141106785 1.00
tpcds_q22/datafusion:vortex-file-compressed 58737244 61135376 0.96
tpcds_q23/datafusion:vortex-file-compressed 152803686 156235459 0.98
tpcds_q24/datafusion:vortex-file-compressed 120374665 116014912 1.04
tpcds_q25/datafusion:vortex-file-compressed 71328227 71693199 0.99
tpcds_q26/datafusion:vortex-file-compressed 38394010 38099322 1.01
tpcds_q27/datafusion:vortex-file-compressed 125402061 124871326 1.00
tpcds_q28/datafusion:vortex-file-compressed 51128506 51192458 1.00
tpcds_q29/datafusion:vortex-file-compressed 69378032 71871693 0.97
tpcds_q30/datafusion:vortex-file-compressed 32018180 31049926 1.03
tpcds_q31/datafusion:vortex-file-compressed 102481235 101736220 1.01
tpcds_q32/datafusion:vortex-file-compressed 23080090 22443555 1.03
tpcds_q33/datafusion:vortex-file-compressed 40620343 39518993 1.03
tpcds_q34/datafusion:vortex-file-compressed 35663504 34660904 1.03
tpcds_q35/datafusion:vortex-file-compressed 58542103 58761992 1.00
tpcds_q36/datafusion:vortex-file-compressed 78866633 78749251 1.00
tpcds_q37/datafusion:vortex-file-compressed 34119768 35195720 0.97
tpcds_q38/datafusion:vortex-file-compressed 54977344 55667510 0.99
tpcds_q39/datafusion:vortex-file-compressed 164402144 152632329 1.08
tpcds_q40/datafusion:vortex-file-compressed 54785559 56662081 0.97
tpcds_q41/datafusion:vortex-file-compressed 18727209 18198368 1.03
tpcds_q42/datafusion:vortex-file-compressed 19609906 18998799 1.03
tpcds_q43/datafusion:vortex-file-compressed 33810925 32384176 1.04
tpcds_q44/datafusion:vortex-file-compressed 46210197 48101813 0.96
tpcds_q45/datafusion:vortex-file-compressed 35450875 34725844 1.02
tpcds_q46/datafusion:vortex-file-compressed 52809210 50631374 1.04
tpcds_q47/datafusion:vortex-file-compressed 212237116 208528699 1.02
tpcds_q48/datafusion:vortex-file-compressed 51104502 50331685 1.02
tpcds_q49/datafusion:vortex-file-compressed 72210062 72559245 1.00
tpcds_q50/datafusion:vortex-file-compressed 48316704 47792240 1.01
tpcds_q51/datafusion:vortex-file-compressed 92614282 89006149 1.04
tpcds_q52/datafusion:vortex-file-compressed 19524616 19395874 1.01
tpcds_q53/datafusion:vortex-file-compressed 26843501 26438280 1.02
tpcds_q54/datafusion:vortex-file-compressed 46864825 45185596 1.04
tpcds_q55/datafusion:vortex-file-compressed 18484442 18660425 0.99
tpcds_q56/datafusion:vortex-file-compressed 43847547 40768588 1.08
tpcds_q57/datafusion:vortex-file-compressed 134044993 126428897 1.06
tpcds_q58/datafusion:vortex-file-compressed 74235784 69250686 1.07
tpcds_q59/datafusion:vortex-file-compressed 75444372 74500499 1.01
tpcds_q60/datafusion:vortex-file-compressed 44284195 44143710 1.00
tpcds_q61/datafusion:vortex-file-compressed 53334288 57144294 0.93
tpcds_q62/datafusion:vortex-file-compressed 33302132 33375706 1.00
tpcds_q63/datafusion:vortex-file-compressed 27560034 27975467 0.99
tpcds_q64/datafusion:vortex-file-compressed 490931578 498042086 0.99
tpcds_q65/datafusion:vortex-file-compressed 50244933 52641480 0.95
tpcds_q66/datafusion:vortex-file-compressed 92608197 98756988 0.94
tpcds_q67/datafusion:vortex-file-compressed 118311893 125967854 0.94
tpcds_q68/datafusion:vortex-file-compressed 50223217 51030362 0.98
tpcds_q69/datafusion:vortex-file-compressed 46898690 45993083 1.02
tpcds_q70/datafusion:vortex-file-compressed 117014500 118321244 0.99
tpcds_q71/datafusion:vortex-file-compressed 32272978 35188762 0.92
tpcds_q72/datafusion:vortex-file-compressed 2647842633 2670510142 0.99
tpcds_q73/datafusion:vortex-file-compressed 34478351 36883260 0.93
tpcds_q74/datafusion:vortex-file-compressed 122372833 119078949 1.03
tpcds_q75/datafusion:vortex-file-compressed 127302085 122644651 1.04
tpcds_q76/datafusion:vortex-file-compressed 36621746 34954293 1.05
tpcds_q77/datafusion:vortex-file-compressed 53234718 53664549 0.99
tpcds_q78/datafusion:vortex-file-compressed 131921690 127504583 1.03
tpcds_q79/datafusion:vortex-file-compressed 42046352 41278486 1.02
tpcds_q80/datafusion:vortex-file-compressed 115284528 112258662 1.03
tpcds_q81/datafusion:vortex-file-compressed 38209182 37514690 1.02
tpcds_q82/datafusion:vortex-file-compressed 37983479 36058619 1.05
tpcds_q83/datafusion:vortex-file-compressed 50855731 50936878 1.00
tpcds_q84/datafusion:vortex-file-compressed 15494548 15284124 1.01
tpcds_q85/datafusion:vortex-file-compressed 106455818 101398161 1.05
tpcds_q86/datafusion:vortex-file-compressed 🚨 20309388 18415062 1.10
tpcds_q87/datafusion:vortex-file-compressed 55030981 55991719 0.98
tpcds_q88/datafusion:vortex-file-compressed 84482972 83832071 1.01
tpcds_q89/datafusion:vortex-file-compressed 38427135 36623678 1.05
tpcds_q90/datafusion:vortex-file-compressed 19329478 18944142 1.02
tpcds_q91/datafusion:vortex-file-compressed 26808061 28551373 0.94
tpcds_q92/datafusion:vortex-file-compressed 20165921 20901647 0.96
tpcds_q93/datafusion:vortex-file-compressed 36503815 37597620 0.97
tpcds_q94/datafusion:vortex-file-compressed 25688682 27826649 0.92
tpcds_q95/datafusion:vortex-file-compressed 61878136 61737580 1.00
tpcds_q96/datafusion:vortex-file-compressed 19191909 18820037 1.02
tpcds_q97/datafusion:vortex-file-compressed 33289213 33725254 0.99
tpcds_q98/datafusion:vortex-file-compressed 35162954 32999009 1.07
tpcds_q99/datafusion:vortex-file-compressed 47918359 47936591 1.00
datafusion / vortex-compact (1.031x ➖, 0↑ 0↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 38386969 37506057 1.02
tpcds_q02/datafusion:vortex-compact 58992363 58964863 1.00
tpcds_q03/datafusion:vortex-compact 26582260 25958669 1.02
tpcds_q04/datafusion:vortex-compact 340283118 327459032 1.04
tpcds_q05/datafusion:vortex-compact 66576731 64773839 1.03
tpcds_q06/datafusion:vortex-compact 58812349 55282044 1.06
tpcds_q07/datafusion:vortex-compact 67257573 66680651 1.01
tpcds_q08/datafusion:vortex-compact 45780452 46761124 0.98
tpcds_q09/datafusion:vortex-compact 104627008 102161460 1.02
tpcds_q10/datafusion:vortex-compact 64543896 62498828 1.03
tpcds_q11/datafusion:vortex-compact 193604861 185538108 1.04
tpcds_q12/datafusion:vortex-compact 27592308 26006862 1.06
tpcds_q13/datafusion:vortex-compact 144056324 132941472 1.08
tpcds_q14/datafusion:vortex-compact 263104397 253013090 1.04
tpcds_q15/datafusion:vortex-compact 41308638 39270186 1.05
tpcds_q16/datafusion:vortex-compact 40639449 38605996 1.05
tpcds_q17/datafusion:vortex-compact 97599938 92873280 1.05
tpcds_q18/datafusion:vortex-compact 96971744 93418453 1.04
tpcds_q19/datafusion:vortex-compact 44362835 42396730 1.05
tpcds_q20/datafusion:vortex-compact 31058291 30050748 1.03
tpcds_q21/datafusion:vortex-compact 151545965 139372790 1.09
tpcds_q22/datafusion:vortex-compact 68656605 66203123 1.04
tpcds_q23/datafusion:vortex-compact 194360695 182954465 1.06
tpcds_q24/datafusion:vortex-compact 145059584 140636041 1.03
tpcds_q25/datafusion:vortex-compact 94811568 93229417 1.02
tpcds_q26/datafusion:vortex-compact 48896746 48614922 1.01
tpcds_q27/datafusion:vortex-compact 163751719 155528903 1.05
tpcds_q28/datafusion:vortex-compact 103054788 101060189 1.02
tpcds_q29/datafusion:vortex-compact 99864102 94200999 1.06
tpcds_q30/datafusion:vortex-compact 38580308 37540965 1.03
tpcds_q31/datafusion:vortex-compact 130449717 124085498 1.05
tpcds_q32/datafusion:vortex-compact 27832633 26424429 1.05
tpcds_q33/datafusion:vortex-compact 52127079 51848272 1.01
tpcds_q34/datafusion:vortex-compact 49902064 48510677 1.03
tpcds_q35/datafusion:vortex-compact 72019348 67980551 1.06
tpcds_q36/datafusion:vortex-compact 99076605 96287932 1.03
tpcds_q37/datafusion:vortex-compact 48998338 46102349 1.06
tpcds_q38/datafusion:vortex-compact 67768170 66348657 1.02
tpcds_q39/datafusion:vortex-compact 156111343 159493778 0.98
tpcds_q40/datafusion:vortex-compact 60807057 57981856 1.05
tpcds_q41/datafusion:vortex-compact 21683456 20547266 1.06
tpcds_q42/datafusion:vortex-compact 25126883 24449054 1.03
tpcds_q43/datafusion:vortex-compact 38396114 38873563 0.99
tpcds_q44/datafusion:vortex-compact 79130630 77224746 1.02
tpcds_q45/datafusion:vortex-compact 38441182 37286384 1.03
tpcds_q46/datafusion:vortex-compact 68284641 69417271 0.98
tpcds_q47/datafusion:vortex-compact 233011952 224457929 1.04
tpcds_q48/datafusion:vortex-compact 98781127 100128878 0.99
tpcds_q49/datafusion:vortex-compact 100059812 95177455 1.05
tpcds_q50/datafusion:vortex-compact 63329124 62040535 1.02
tpcds_q51/datafusion:vortex-compact 99195067 96966033 1.02
tpcds_q52/datafusion:vortex-compact 25808175 25207875 1.02
tpcds_q53/datafusion:vortex-compact 35844252 34026770 1.05
tpcds_q54/datafusion:vortex-compact 60107526 56054261 1.07
tpcds_q55/datafusion:vortex-compact 25819470 23831792 1.08
tpcds_q56/datafusion:vortex-compact 55458804 53252565 1.04
tpcds_q57/datafusion:vortex-compact 149146512 139739658 1.07
tpcds_q58/datafusion:vortex-compact 80573095 76949245 1.05
tpcds_q59/datafusion:vortex-compact 88008425 84295006 1.04
tpcds_q60/datafusion:vortex-compact 56559759 54066713 1.05
tpcds_q61/datafusion:vortex-compact 72579820 71156982 1.02
tpcds_q62/datafusion:vortex-compact 34437174 32676278 1.05
tpcds_q63/datafusion:vortex-compact 35647610 34773064 1.03
tpcds_q64/datafusion:vortex-compact 563654197 540483157 1.04
tpcds_q65/datafusion:vortex-compact 68094030 68259361 1.00
tpcds_q66/datafusion:vortex-compact 101110285 98546069 1.03
tpcds_q67/datafusion:vortex-compact 135611663 131416987 1.03
tpcds_q68/datafusion:vortex-compact 74239943 70179286 1.06
tpcds_q69/datafusion:vortex-compact 60323337 58782685 1.03
tpcds_q70/datafusion:vortex-compact 128161710 125352144 1.02
tpcds_q71/datafusion:vortex-compact 45628089 45247708 1.01
tpcds_q72/datafusion:vortex-compact 2714352387 2582026783 1.05
tpcds_q73/datafusion:vortex-compact 50424180 51451928 0.98
tpcds_q74/datafusion:vortex-compact 137268788 132756398 1.03
tpcds_q75/datafusion:vortex-compact 173821240 165888941 1.05
tpcds_q76/datafusion:vortex-compact 52045052 51470401 1.01
tpcds_q77/datafusion:vortex-compact 68511646 67716749 1.01
tpcds_q78/datafusion:vortex-compact 153181097 148612231 1.03
tpcds_q79/datafusion:vortex-compact 59865636 58304328 1.03
tpcds_q80/datafusion:vortex-compact 140446611 131517375 1.07
tpcds_q81/datafusion:vortex-compact 44620922 43038524 1.04
tpcds_q82/datafusion:vortex-compact 50290630 50258327 1.00
tpcds_q83/datafusion:vortex-compact 62036242 60819934 1.02
tpcds_q84/datafusion:vortex-compact 19500909 19646003 0.99
tpcds_q85/datafusion:vortex-compact 130056708 128017567 1.02
tpcds_q86/datafusion:vortex-compact 21638729 20326755 1.06
tpcds_q87/datafusion:vortex-compact 67902054 65985453 1.03
tpcds_q88/datafusion:vortex-compact 132881256 131555461 1.01
tpcds_q89/datafusion:vortex-compact 46397788 43639971 1.06
tpcds_q90/datafusion:vortex-compact 25152742 25029684 1.00
tpcds_q91/datafusion:vortex-compact 42352254 40751142 1.04
tpcds_q92/datafusion:vortex-compact 22922633 21364327 1.07
tpcds_q93/datafusion:vortex-compact 47966669 46832472 1.02
tpcds_q94/datafusion:vortex-compact 32729190 32504690 1.01
tpcds_q95/datafusion:vortex-compact 73372788 74468565 0.99
tpcds_q96/datafusion:vortex-compact 26353360 26076005 1.01
tpcds_q97/datafusion:vortex-compact 42770103 41145266 1.04
tpcds_q98/datafusion:vortex-compact 39367847 39369058 1.00
tpcds_q99/datafusion:vortex-compact 49046611 50630004 0.97
datafusion / parquet (1.015x ➖, 2↑ 1↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 36491510 36539704 1.00
tpcds_q02/datafusion:parquet 46920578 45561317 1.03
tpcds_q03/datafusion:parquet 15784755 15195380 1.04
tpcds_q04/datafusion:parquet 336405644 317762487 1.06
tpcds_q05/datafusion:parquet 53630035 51784654 1.04
tpcds_q06/datafusion:parquet 67257818 63333366 1.06
tpcds_q07/datafusion:parquet 94720749 87983196 1.08
tpcds_q08/datafusion:parquet 33595775 31907270 1.05
tpcds_q09/datafusion:parquet 🚀 58206809 65382176 0.89
tpcds_q10/datafusion:parquet 86300505 83328706 1.04
tpcds_q11/datafusion:parquet 183999636 188399374 0.98
tpcds_q12/datafusion:parquet 24479843 22955777 1.07
tpcds_q13/datafusion:parquet 91683286 86859907 1.06
tpcds_q14/datafusion:parquet 203625279 202657744 1.00
tpcds_q15/datafusion:parquet 26983402 26208725 1.03
tpcds_q16/datafusion:parquet 30654931 28723191 1.07
tpcds_q17/datafusion:parquet 72316707 71488518 1.01
tpcds_q18/datafusion:parquet 135754983 136925042 0.99
tpcds_q19/datafusion:parquet 27763946 28544668 0.97
tpcds_q20/datafusion:parquet 22386117 21375804 1.05
tpcds_q21/datafusion:parquet 22211861 22593819 0.98
tpcds_q22/datafusion:parquet 149628333 139654637 1.07
tpcds_q23/datafusion:parquet 168418397 164188013 1.03
tpcds_q24/datafusion:parquet 108206508 104054977 1.04
tpcds_q25/datafusion:parquet 75135048 71598212 1.05
tpcds_q26/datafusion:parquet 77550296 76802368 1.01
tpcds_q27/datafusion:parquet 167830765 166199797 1.01
tpcds_q28/datafusion:parquet 49484485 50818670 0.97
tpcds_q29/datafusion:parquet 75487733 73072053 1.03
tpcds_q30/datafusion:parquet 46953996 44493412 1.06
tpcds_q31/datafusion:parquet 76846482 75763563 1.01
tpcds_q32/datafusion:parquet 23503945 21851824 1.08
tpcds_q33/datafusion:parquet 35710340 35124996 1.02
tpcds_q34/datafusion:parquet 🚨 29709458 26816277 1.11
tpcds_q35/datafusion:parquet 88567447 85681687 1.03
tpcds_q36/datafusion:parquet 66547507 65371333 1.02
tpcds_q37/datafusion:parquet 24087272 23403638 1.03
tpcds_q38/datafusion:parquet 51889871 51061730 1.02
tpcds_q39/datafusion:parquet 86562820 84045666 1.03
tpcds_q40/datafusion:parquet 29254241 27194156 1.08
tpcds_q41/datafusion:parquet 16201878 15385268 1.05
tpcds_q42/datafusion:parquet 14212448 13888552 1.02
tpcds_q43/datafusion:parquet 20219295 18933423 1.07
tpcds_q44/datafusion:parquet 42096522 41272793 1.02
tpcds_q45/datafusion:parquet 33125558 33578810 0.99
tpcds_q46/datafusion:parquet 39486505 38808905 1.02
tpcds_q47/datafusion:parquet 141398626 137564470 1.03
tpcds_q48/datafusion:parquet 79793453 79938458 1.00
tpcds_q49/datafusion:parquet 67546401 66791707 1.01
tpcds_q50/datafusion:parquet 51348543 48879223 1.05
tpcds_q51/datafusion:parquet 92683210 90652667 1.02
tpcds_q52/datafusion:parquet 14756309 14325840 1.03
tpcds_q53/datafusion:parquet 22525356 21498522 1.05
tpcds_q54/datafusion:parquet 43325048 42506780 1.02
tpcds_q55/datafusion:parquet 14295336 13522309 1.06
tpcds_q56/datafusion:parquet 37190072 36667064 1.01
tpcds_q57/datafusion:parquet 109587847 110369345 0.99
tpcds_q58/datafusion:parquet 60734431 58544646 1.04
tpcds_q59/datafusion:parquet 60033460 57830064 1.04
tpcds_q60/datafusion:parquet 36346355 34652354 1.05
tpcds_q61/datafusion:parquet 53945209 50294626 1.07
tpcds_q62/datafusion:parquet 29757917 28286379 1.05
tpcds_q63/datafusion:parquet 22892666 22187168 1.03
tpcds_q64/datafusion:parquet 571371147 555977341 1.03
tpcds_q65/datafusion:parquet 45350863 45356219 1.00
tpcds_q66/datafusion:parquet 78210574 76774624 1.02
tpcds_q67/datafusion:parquet 156420891 153129671 1.02
tpcds_q68/datafusion:parquet 40253333 40619186 0.99
tpcds_q69/datafusion:parquet 80506083 81060772 0.99
tpcds_q70/datafusion:parquet 101259601 102507410 0.99
tpcds_q71/datafusion:parquet 27741264 25670704 1.08
tpcds_q72/datafusion:parquet 660345559 634782356 1.04
tpcds_q73/datafusion:parquet 26861308 26779390 1.00
tpcds_q74/datafusion:parquet 107665048 106948562 1.01
tpcds_q75/datafusion:parquet 122129528 120984237 1.01
tpcds_q76/datafusion:parquet 37246090 37839087 0.98
tpcds_q77/datafusion:parquet 50457228 52351380 0.96
tpcds_q78/datafusion:parquet 126396436 127918028 0.99
tpcds_q79/datafusion:parquet 31773256 33210965 0.96
tpcds_q80/datafusion:parquet 98164145 96746361 1.01
tpcds_q81/datafusion:parquet 42849777 42508322 1.01
tpcds_q82/datafusion:parquet 24527897 25227447 0.97
tpcds_q83/datafusion:parquet 49962816 50887103 0.98
tpcds_q84/datafusion:parquet 49128637 49306106 1.00
tpcds_q85/datafusion:parquet 178247205 176940481 1.01
tpcds_q86/datafusion:parquet 20080014 19548518 1.03
tpcds_q87/datafusion:parquet 50800714 55559433 0.91
tpcds_q88/datafusion:parquet 72743522 71978874 1.01
tpcds_q89/datafusion:parquet 25376829 25072183 1.01
tpcds_q90/datafusion:parquet 20686504 19696482 1.05
tpcds_q91/datafusion:parquet 72162530 76110067 0.95
tpcds_q92/datafusion:parquet 22562126 23598365 0.96
tpcds_q93/datafusion:parquet 36776947 35501793 1.04
tpcds_q94/datafusion:parquet 25139747 26696545 0.94
tpcds_q95/datafusion:parquet 69236847 71775285 0.96
tpcds_q96/datafusion:parquet 14944582 15901036 0.94
tpcds_q97/datafusion:parquet 34084719 34535265 0.99
tpcds_q98/datafusion:parquet 26288895 26419395 1.00
tpcds_q99/datafusion:parquet 🚀 29959057 36037096 0.83
duckdb / vortex-file-compressed (1.024x ➖, 0↑ 0↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 26610646 25690934 1.04
tpcds_q02/duckdb:vortex-file-compressed 85003466 83733170 1.02
tpcds_q03/duckdb:vortex-file-compressed 24782655 25022115 0.99
tpcds_q04/duckdb:vortex-file-compressed 109092661 102961800 1.06
tpcds_q05/duckdb:vortex-file-compressed 106082428 99787873 1.06
tpcds_q06/duckdb:vortex-file-compressed 38629609 36832983 1.05
tpcds_q07/duckdb:vortex-file-compressed 25812327 24874562 1.04
tpcds_q08/duckdb:vortex-file-compressed 24471255 22865499 1.07
tpcds_q09/duckdb:vortex-file-compressed 41144864 39830028 1.03
tpcds_q10/duckdb:vortex-file-compressed 37736818 37148714 1.02
tpcds_q11/duckdb:vortex-file-compressed 64691667 61590192 1.05
tpcds_q12/duckdb:vortex-file-compressed 14865517 14048276 1.06
tpcds_q13/duckdb:vortex-file-compressed 35352033 35390480 1.00
tpcds_q14/duckdb:vortex-file-compressed 196550868 202485024 0.97
tpcds_q15/duckdb:vortex-file-compressed 42244052 40715593 1.04
tpcds_q16/duckdb:vortex-file-compressed 31493723 29872460 1.05
tpcds_q17/duckdb:vortex-file-compressed 40974576 39355327 1.04
tpcds_q18/duckdb:vortex-file-compressed 48183729 44702092 1.08
tpcds_q19/duckdb:vortex-file-compressed 34861061 32983804 1.06
tpcds_q20/duckdb:vortex-file-compressed 16777214 16889469 0.99
tpcds_q21/duckdb:vortex-file-compressed 20343288 21485116 0.95
tpcds_q22/duckdb:vortex-file-compressed 110212463 110109938 1.00
tpcds_q23/duckdb:vortex-file-compressed 127223813 128841966 0.99
tpcds_q24/duckdb:vortex-file-compressed 56693718 55629865 1.02
tpcds_q25/duckdb:vortex-file-compressed 38560459 38225178 1.01
tpcds_q26/duckdb:vortex-file-compressed 40203379 38273938 1.05
tpcds_q27/duckdb:vortex-file-compressed 89811338 90528180 0.99
tpcds_q28/duckdb:vortex-file-compressed 37021852 36935597 1.00
tpcds_q29/duckdb:vortex-file-compressed 37581920 37912314 0.99
tpcds_q30/duckdb:vortex-file-compressed 28527686 29361887 0.97
tpcds_q31/duckdb:vortex-file-compressed 26930729 25894953 1.04
tpcds_q32/duckdb:vortex-file-compressed 17502805 16948636 1.03
tpcds_q33/duckdb:vortex-file-compressed 69994069 70992212 0.99
tpcds_q34/duckdb:vortex-file-compressed 20187665 19611448 1.03
tpcds_q35/duckdb:vortex-file-compressed 65330826 64805384 1.01
tpcds_q36/duckdb:vortex-file-compressed 28309209 27308934 1.04
tpcds_q37/duckdb:vortex-file-compressed 22811001 21949819 1.04
tpcds_q38/duckdb:vortex-file-compressed 37919782 36886837 1.03
tpcds_q39/duckdb:vortex-file-compressed 47491145 51267519 0.93
tpcds_q40/duckdb:vortex-file-compressed 25825412 25212127 1.02
tpcds_q41/duckdb:vortex-file-compressed 14139278 13706848 1.03
tpcds_q42/duckdb:vortex-file-compressed 11618552 12033596 0.97
tpcds_q43/duckdb:vortex-file-compressed 20302980 20209061 1.00
tpcds_q44/duckdb:vortex-file-compressed 23743969 21694880 1.09
tpcds_q45/duckdb:vortex-file-compressed 27136397 25958666 1.05
tpcds_q46/duckdb:vortex-file-compressed 50050436 48605227 1.03
tpcds_q47/duckdb:vortex-file-compressed 50589782 49296527 1.03
tpcds_q48/duckdb:vortex-file-compressed 32746347 31497962 1.04
tpcds_q49/duckdb:vortex-file-compressed 30340874 30473029 1.00
tpcds_q50/duckdb:vortex-file-compressed 38104122 36874849 1.03
tpcds_q51/duckdb:vortex-file-compressed 100828464 98889691 1.02
tpcds_q52/duckdb:vortex-file-compressed 12813470 12135977 1.06
tpcds_q53/duckdb:vortex-file-compressed 17673789 17356855 1.02
tpcds_q54/duckdb:vortex-file-compressed 50724091 53075752 0.96
tpcds_q55/duckdb:vortex-file-compressed 11756229 11284153 1.04
tpcds_q56/duckdb:vortex-file-compressed 69763005 70414237 0.99
tpcds_q57/duckdb:vortex-file-compressed 44490943 44065939 1.01
tpcds_q58/duckdb:vortex-file-compressed 34163953 32761234 1.04
tpcds_q59/duckdb:vortex-file-compressed 64293796 62703042 1.03
tpcds_q60/duckdb:vortex-file-compressed 73770820 70115220 1.05
tpcds_q61/duckdb:vortex-file-compressed 38833511 41236592 0.94
tpcds_q62/duckdb:vortex-file-compressed 18811184 18054972 1.04
tpcds_q63/duckdb:vortex-file-compressed 17917123 18115730 0.99
tpcds_q64/duckdb:vortex-file-compressed 83495518 82059672 1.02
tpcds_q65/duckdb:vortex-file-compressed 23539039 22879012 1.03
tpcds_q66/duckdb:vortex-file-compressed 62223065 59782409 1.04
tpcds_q67/duckdb:vortex-file-compressed 151794757 144236300 1.05
tpcds_q68/duckdb:vortex-file-compressed 41154227 41638162 0.99
tpcds_q69/duckdb:vortex-file-compressed 40410188 39042478 1.04
tpcds_q70/duckdb:vortex-file-compressed 24973812 25241562 0.99
tpcds_q71/duckdb:vortex-file-compressed 21903564 21729170 1.01
tpcds_q72/duckdb:vortex-file-compressed 179764419 179674516 1.00
tpcds_q73/duckdb:vortex-file-compressed 20877538 20299249 1.03
tpcds_q74/duckdb:vortex-file-compressed 51479772 50870735 1.01
tpcds_q75/duckdb:vortex-file-compressed 64266505 60668680 1.06
tpcds_q76/duckdb:vortex-file-compressed 76202818 79709782 0.96
tpcds_q77/duckdb:vortex-file-compressed 67879100 68749061 0.99
tpcds_q78/duckdb:vortex-file-compressed 82034051 78728778 1.04
tpcds_q79/duckdb:vortex-file-compressed 43741685 42891722 1.02
tpcds_q80/duckdb:vortex-file-compressed 93050929 96218813 0.97
tpcds_q81/duckdb:vortex-file-compressed 35720402 34234059 1.04
tpcds_q82/duckdb:vortex-file-compressed 23990148 22468020 1.07
tpcds_q83/duckdb:vortex-file-compressed 29416337 28834228 1.02
tpcds_q84/duckdb:vortex-file-compressed 18382536 16912341 1.09
tpcds_q85/duckdb:vortex-file-compressed 47307176 44924616 1.05
tpcds_q86/duckdb:vortex-file-compressed 18005834 17271257 1.04
tpcds_q87/duckdb:vortex-file-compressed 42433491 39250443 1.08
tpcds_q88/duckdb:vortex-file-compressed 37191731 34383113 1.08
tpcds_q89/duckdb:vortex-file-compressed 18846638 18092703 1.04
tpcds_q90/duckdb:vortex-file-compressed 15905773 16063532 0.99
tpcds_q91/duckdb:vortex-file-compressed 29771593 27683286 1.08
tpcds_q92/duckdb:vortex-file-compressed 14451676 13468147 1.07
tpcds_q93/duckdb:vortex-file-compressed 30591990 28574559 1.07
tpcds_q94/duckdb:vortex-file-compressed 23235465 22252190 1.04
tpcds_q95/duckdb:vortex-file-compressed 159014047 153499446 1.04
tpcds_q96/duckdb:vortex-file-compressed 12259963 11678191 1.05
tpcds_q97/duckdb:vortex-file-compressed 39965220 39011146 1.02
tpcds_q98/duckdb:vortex-file-compressed 18845209 18054374 1.04
tpcds_q99/duckdb:vortex-file-compressed 33274365 32491806 1.02
duckdb / vortex-compact (1.037x ➖, 0↑ 7↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 34991307 34807829 1.01
tpcds_q02/duckdb:vortex-compact 127290027 125738288 1.01
tpcds_q03/duckdb:vortex-compact 51240622 52507096 0.98
tpcds_q04/duckdb:vortex-compact 128798939 121693864 1.06
tpcds_q05/duckdb:vortex-compact 163226369 166478553 0.98
tpcds_q06/duckdb:vortex-compact 38798404 37554152 1.03
tpcds_q07/duckdb:vortex-compact 36686713 37535088 0.98
tpcds_q08/duckdb:vortex-compact 29252749 28121278 1.04
tpcds_q09/duckdb:vortex-compact 112086854 108881639 1.03
tpcds_q10/duckdb:vortex-compact 47776872 46908929 1.02
tpcds_q11/duckdb:vortex-compact 76887626 73364778 1.05
tpcds_q12/duckdb:vortex-compact 20265337 19085864 1.06
tpcds_q13/duckdb:vortex-compact 49081241 48014791 1.02
tpcds_q14/duckdb:vortex-compact 273718085 279315764 0.98
tpcds_q15/duckdb:vortex-compact 47273803 45739101 1.03
tpcds_q16/duckdb:vortex-compact 36396101 37429614 0.97
tpcds_q17/duckdb:vortex-compact 49489650 49405004 1.00
tpcds_q18/duckdb:vortex-compact 69170889 68674242 1.01
tpcds_q19/duckdb:vortex-compact 39006195 38068901 1.02
tpcds_q20/duckdb:vortex-compact 21734269 20824292 1.04
tpcds_q21/duckdb:vortex-compact 29047191 29081977 1.00
tpcds_q22/duckdb:vortex-compact 121065995 118644127 1.02
tpcds_q23/duckdb:vortex-compact 159548811 156301267 1.02
tpcds_q24/duckdb:vortex-compact 74001523 70610599 1.05
tpcds_q25/duckdb:vortex-compact 51533354 49523599 1.04
tpcds_q26/duckdb:vortex-compact 52803945 49651529 1.06
tpcds_q27/duckdb:vortex-compact 134823799 127986234 1.05
tpcds_q28/duckdb:vortex-compact 111862279 107032262 1.05
tpcds_q29/duckdb:vortex-compact 50186392 46247285 1.09
tpcds_q30/duckdb:vortex-compact 37355990 35616010 1.05
tpcds_q31/duckdb:vortex-compact 🚨 33334816 30065904 1.11
tpcds_q32/duckdb:vortex-compact 23576430 22799883 1.03
tpcds_q33/duckdb:vortex-compact 135706766 136067176 1.00
tpcds_q34/duckdb:vortex-compact 22774011 22683458 1.00
tpcds_q35/duckdb:vortex-compact 🚨 73782534 65789198 1.12
tpcds_q36/duckdb:vortex-compact 34217244 33626929 1.02
tpcds_q37/duckdb:vortex-compact 33175686 30510111 1.09
tpcds_q38/duckdb:vortex-compact 42125714 39749782 1.06
tpcds_q39/duckdb:vortex-compact 56271865 55122037 1.02
tpcds_q40/duckdb:vortex-compact 32792850 30990473 1.06
tpcds_q41/duckdb:vortex-compact 🚨 18219303 16364727 1.11
tpcds_q42/duckdb:vortex-compact 15933331 14737478 1.08
tpcds_q43/duckdb:vortex-compact 24471659 22606900 1.08
tpcds_q44/duckdb:vortex-compact 29875867 29257089 1.02
tpcds_q45/duckdb:vortex-compact 34757525 32728457 1.06
tpcds_q46/duckdb:vortex-compact 58640130 57211561 1.02
tpcds_q47/duckdb:vortex-compact 55708697 54384967 1.02
tpcds_q48/duckdb:vortex-compact 41400071 38091845 1.09
tpcds_q49/duckdb:vortex-compact 49922386 49266905 1.01
tpcds_q50/duckdb:vortex-compact 37923711 36574329 1.04
tpcds_q51/duckdb:vortex-compact 105734659 104544235 1.01
tpcds_q52/duckdb:vortex-compact 16415360 15454220 1.06
tpcds_q53/duckdb:vortex-compact 21569442 21333893 1.01
tpcds_q54/duckdb:vortex-compact 85808869 84826376 1.01
tpcds_q55/duckdb:vortex-compact 🚨 16663650 15086293 1.10
tpcds_q56/duckdb:vortex-compact 129651802 129987647 1.00
tpcds_q57/duckdb:vortex-compact 49285824 48314083 1.02
tpcds_q58/duckdb:vortex-compact 43269730 42768443 1.01
tpcds_q59/duckdb:vortex-compact 76860306 74204343 1.04
tpcds_q60/duckdb:vortex-compact 134741930 130217310 1.03
tpcds_q61/duckdb:vortex-compact 48685471 45068049 1.08
tpcds_q62/duckdb:vortex-compact 22734779 22255207 1.02
tpcds_q63/duckdb:vortex-compact 🚨 23519942 21376032 1.10
tpcds_q64/duckdb:vortex-compact 101600279 98066861 1.04
tpcds_q65/duckdb:vortex-compact 27126047 26727459 1.01
tpcds_q66/duckdb:vortex-compact 106216728 97023529 1.09
tpcds_q67/duckdb:vortex-compact 154866569 154608273 1.00
tpcds_q68/duckdb:vortex-compact 52707665 51799684 1.02
tpcds_q69/duckdb:vortex-compact 48175377 45877388 1.05
tpcds_q70/duckdb:vortex-compact 29781371 27802507 1.07
tpcds_q71/duckdb:vortex-compact 26492856 24170488 1.10
tpcds_q72/duckdb:vortex-compact 201855804 199454401 1.01
tpcds_q73/duckdb:vortex-compact 22511547 22271348 1.01
tpcds_q74/duckdb:vortex-compact 57567556 56089288 1.03
tpcds_q75/duckdb:vortex-compact 71763137 69970664 1.03
tpcds_q76/duckdb:vortex-compact 129031664 120288746 1.07
tpcds_q77/duckdb:vortex-compact 130626279 128829202 1.01
tpcds_q78/duckdb:vortex-compact 89190446 89059583 1.00
tpcds_q79/duckdb:vortex-compact 69628501 70419575 0.99
tpcds_q80/duckdb:vortex-compact 160514303 157908318 1.02
tpcds_q81/duckdb:vortex-compact 🚨 44581699 39744793 1.12
tpcds_q82/duckdb:vortex-compact 33469631 31025641 1.08
tpcds_q83/duckdb:vortex-compact 47847253 45213172 1.06
tpcds_q84/duckdb:vortex-compact 22223285 21563137 1.03
tpcds_q85/duckdb:vortex-compact 63126072 62129874 1.02
tpcds_q86/duckdb:vortex-compact 19585965 19627437 1.00
tpcds_q87/duckdb:vortex-compact 43073354 43572004 0.99
tpcds_q88/duckdb:vortex-compact 36622554 34478179 1.06
tpcds_q89/duckdb:vortex-compact 23274188 22163688 1.05
tpcds_q90/duckdb:vortex-compact 16915705 16059516 1.05
tpcds_q91/duckdb:vortex-compact 45402913 43165641 1.05
tpcds_q92/duckdb:vortex-compact 21592648 21064259 1.03
tpcds_q93/duckdb:vortex-compact 🚨 39030112 35258925 1.11
tpcds_q94/duckdb:vortex-compact 27917880 27848455 1.00
tpcds_q95/duckdb:vortex-compact 164269257 159868376 1.03
tpcds_q96/duckdb:vortex-compact 11890483 11286469 1.05
tpcds_q97/duckdb:vortex-compact 44251194 41544388 1.07
tpcds_q98/duckdb:vortex-compact 24620960 23236257 1.06
tpcds_q99/duckdb:vortex-compact 36080894 36939780 0.98
duckdb / parquet (1.024x ➖, 0↑ 3↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 45994221 43832735 1.05
tpcds_q02/duckdb:parquet 59453066 58741420 1.01
tpcds_q03/duckdb:parquet 12156506 12110031 1.00
tpcds_q04/duckdb:parquet 128260028 131684843 0.97
tpcds_q05/duckdb:parquet 78071643 72690313 1.07
tpcds_q06/duckdb:parquet 29355610 28970210 1.01
tpcds_q07/duckdb:parquet 24033352 23112747 1.04
tpcds_q08/duckdb:parquet 29254273 27398857 1.07
tpcds_q09/duckdb:parquet 40202356 39369799 1.02
tpcds_q10/duckdb:parquet 37013062 35125999 1.05
tpcds_q11/duckdb:parquet 88371924 87946603 1.00
tpcds_q12/duckdb:parquet 15248413 14470547 1.05
tpcds_q13/duckdb:parquet 35544564 33989677 1.05
tpcds_q14/duckdb:parquet 163868509 159121238 1.03
tpcds_q15/duckdb:parquet 30636511 29879377 1.03
tpcds_q16/duckdb:parquet 21844323 21027724 1.04
tpcds_q17/duckdb:parquet 40560923 37317971 1.09
tpcds_q18/duckdb:parquet 47468224 46169746 1.03
tpcds_q19/duckdb:parquet 29666269 29273635 1.01
tpcds_q20/duckdb:parquet 15824980 15301499 1.03
tpcds_q21/duckdb:parquet 11613065 11683927 0.99
tpcds_q22/duckdb:parquet 66323614 67155981 0.99
tpcds_q23/duckdb:parquet 115523307 114216505 1.01
tpcds_q24/duckdb:parquet 46809731 45427873 1.03
tpcds_q25/duckdb:parquet 32941916 32740521 1.01
tpcds_q26/duckdb:parquet 35708173 36402134 0.98
tpcds_q27/duckdb:parquet 90193550 88451087 1.02
tpcds_q28/duckdb:parquet 37653326 37216458 1.01
tpcds_q29/duckdb:parquet 35361348 35214787 1.00
tpcds_q30/duckdb:parquet 40956696 40471753 1.01
tpcds_q31/duckdb:parquet 23484677 21960330 1.07
tpcds_q32/duckdb:parquet 11375210 12167962 0.93
tpcds_q33/duckdb:parquet 71848545 73156740 0.98
tpcds_q34/duckdb:parquet 21349351 20895403 1.02
tpcds_q35/duckdb:parquet 60979326 59995813 1.02
tpcds_q36/duckdb:parquet 20776895 20311898 1.02
tpcds_q37/duckdb:parquet 13912193 13581853 1.02
tpcds_q38/duckdb:parquet 35539728 35448554 1.00
tpcds_q39/duckdb:parquet 33140533 31955481 1.04
tpcds_q40/duckdb:parquet 17935512 18094767 0.99
tpcds_q41/duckdb:parquet 7805879 7399046 1.05
tpcds_q42/duckdb:parquet 10297865 10034243 1.03
tpcds_q43/duckdb:parquet 16246058 15481152 1.05
tpcds_q44/duckdb:parquet 20976735 21742447 0.96
tpcds_q45/duckdb:parquet 🚨 29444681 26318553 1.12
tpcds_q46/duckdb:parquet 46879162 44930524 1.04
tpcds_q47/duckdb:parquet 46194843 45312403 1.02
tpcds_q48/duckdb:parquet 31148911 30136384 1.03
tpcds_q49/duckdb:parquet 24565070 24349930 1.01
tpcds_q50/duckdb:parquet 24788177 24673018 1.00
tpcds_q51/duckdb:parquet 98820793 95320735 1.04
tpcds_q52/duckdb:parquet 10908944 10852067 1.01
tpcds_q53/duckdb:parquet 16608803 16007668 1.04
tpcds_q54/duckdb:parquet 🚨 41961429 37727679 1.11
tpcds_q55/duckdb:parquet 10751527 10166919 1.06
tpcds_q56/duckdb:parquet 69863433 69899293 1.00
tpcds_q57/duckdb:parquet 36005896 34448603 1.05
tpcds_q58/duckdb:parquet 21654136 21129798 1.02
tpcds_q59/duckdb:parquet 36540508 36524587 1.00
tpcds_q60/duckdb:parquet 76250590 69337352 1.10
tpcds_q61/duckdb:parquet 31458575 31097235 1.01
tpcds_q62/duckdb:parquet 11567718 11221041 1.03
tpcds_q63/duckdb:parquet 15513028 15184960 1.02
tpcds_q64/duckdb:parquet 76386970 72002126 1.06
tpcds_q65/duckdb:parquet 20996622 20559171 1.02
tpcds_q66/duckdb:parquet 54771722 54549138 1.00
tpcds_q67/duckdb:parquet 141450114 133057184 1.06
tpcds_q68/duckdb:parquet 38194330 37738434 1.01
tpcds_q69/duckdb:parquet 38418555 37962767 1.01
tpcds_q70/duckdb:parquet 19999727 19339985 1.03
tpcds_q71/duckdb:parquet 18690758 18939446 0.99
tpcds_q72/duckdb:parquet 166079759 164633831 1.01
tpcds_q73/duckdb:parquet 18167219 17944744 1.01
tpcds_q74/duckdb:parquet 52926402 51417797 1.03
tpcds_q75/duckdb:parquet 54849385 53568249 1.02
tpcds_q76/duckdb:parquet 70230942 70146887 1.00
tpcds_q77/duckdb:parquet 64142268 64416610 1.00
tpcds_q78/duckdb:parquet 76440838 73190019 1.04
tpcds_q79/duckdb:parquet 29604621 29520706 1.00
tpcds_q80/duckdb:parquet 83941578 83122553 1.01
tpcds_q81/duckdb:parquet 48568236 47707307 1.02
tpcds_q82/duckdb:parquet 15719354 15308790 1.03
tpcds_q83/duckdb:parquet 16375519 15631573 1.05
tpcds_q84/duckdb:parquet 18865352 19694837 0.96
tpcds_q85/duckdb:parquet 40463245 38717057 1.05
tpcds_q86/duckdb:parquet 12310664 11850710 1.04
tpcds_q87/duckdb:parquet 37301141 35882117 1.04
tpcds_q88/duckdb:parquet 29392573 28623258 1.03
tpcds_q89/duckdb:parquet 17557694 17172120 1.02
tpcds_q90/duckdb:parquet 7479154 7338454 1.02
tpcds_q91/duckdb:parquet 23527030 24552821 0.96
tpcds_q92/duckdb:parquet 🚨 12409660 10979524 1.13
tpcds_q93/duckdb:parquet 30838701 29747094 1.04
tpcds_q94/duckdb:parquet 16818157 16403237 1.03
tpcds_q95/duckdb:parquet 132254982 140649157 0.94
tpcds_q96/duckdb:parquet 9444322 9225651 1.02
tpcds_q97/duckdb:parquet 35838029 35180003 1.02
tpcds_q98/duckdb:parquet 18869481 18113761 1.04
tpcds_q99/duckdb:parquet 20652069 19711041 1.05
duckdb / duckdb (1.047x ➖, 0↑ 14↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 🚨 20987165 18572618 1.13
tpcds_q02/duckdb:duckdb 18845942 18864747 1.00
tpcds_q03/duckdb:duckdb 🚨 8723781 7814722 1.12
tpcds_q04/duckdb:duckdb 161939017 160133684 1.01
tpcds_q05/duckdb:duckdb 18766203 18187628 1.03
tpcds_q06/duckdb:duckdb 22684671 21436476 1.06
tpcds_q07/duckdb:duckdb 🚨 39465516 33400061 1.18
tpcds_q08/duckdb:duckdb 121244690 118194970 1.03
tpcds_q09/duckdb:duckdb 20078277 19392681 1.04
tpcds_q10/duckdb:duckdb 23625148 22365539 1.06
tpcds_q11/duckdb:duckdb 141081862 136717636 1.03
tpcds_q12/duckdb:duckdb 🚨 11989413 10852469 1.10
tpcds_q13/duckdb:duckdb 25366423 23536405 1.08
tpcds_q14/duckdb:duckdb 97111748 91729847 1.06
tpcds_q15/duckdb:duckdb 25704815 24028216 1.07
tpcds_q16/duckdb:duckdb 🚨 19014286 16626738 1.14
tpcds_q17/duckdb:duckdb 21526040 21834696 0.99
tpcds_q18/duckdb:duckdb 46516601 42930395 1.08
tpcds_q19/duckdb:duckdb 16630651 15545555 1.07
tpcds_q20/duckdb:duckdb 12083137 11735626 1.03
tpcds_q21/duckdb:duckdb 6659573 6719794 0.99
tpcds_q22/duckdb:duckdb 🚨 66677399 59590510 1.12
tpcds_q23/duckdb:duckdb 74963742 78539956 0.95
tpcds_q24/duckdb:duckdb 🚨 24644378 22386941 1.10
tpcds_q25/duckdb:duckdb 17318505 17079105 1.01
tpcds_q26/duckdb:duckdb 25152668 25486577 0.99
tpcds_q27/duckdb:duckdb 41660321 39591830 1.05
tpcds_q28/duckdb:duckdb 21638995 21072941 1.03
tpcds_q29/duckdb:duckdb 20502547 19687161 1.04
tpcds_q30/duckdb:duckdb 26769132 29316034 0.91
tpcds_q31/duckdb:duckdb 20420716 20541163 0.99
tpcds_q32/duckdb:duckdb 🚨 7825322 6634970 1.18
tpcds_q33/duckdb:duckdb 🚨 13300316 12027701 1.11
tpcds_q34/duckdb:duckdb 14925990 13963791 1.07
tpcds_q35/duckdb:duckdb 33139588 31345456 1.06
tpcds_q36/duckdb:duckdb 72610296 66963567 1.08
tpcds_q37/duckdb:duckdb 7350219 7436489 0.99
tpcds_q38/duckdb:duckdb 31265814 29799492 1.05
tpcds_q39/duckdb:duckdb 25464525 25443666 1.00
tpcds_q40/duckdb:duckdb 14376230 13487305 1.07
tpcds_q41/duckdb:duckdb 7998948 7707843 1.04
tpcds_q42/duckdb:duckdb 6165205 6367694 0.97
tpcds_q43/duckdb:duckdb 11708606 11026509 1.06
tpcds_q44/duckdb:duckdb 13229443 12885301 1.03
tpcds_q45/duckdb:duckdb 17771607 17086456 1.04
tpcds_q46/duckdb:duckdb 35978197 34620723 1.04
tpcds_q47/duckdb:duckdb 40977830 40367354 1.02
tpcds_q48/duckdb:duckdb 21824884 21290528 1.03
tpcds_q49/duckdb:duckdb 17157738 16557542 1.04
tpcds_q50/duckdb:duckdb 13839326 13885112 1.00
tpcds_q51/duckdb:duckdb 93036605 90270932 1.03
tpcds_q52/duckdb:duckdb 7274139 7186663 1.01
tpcds_q53/duckdb:duckdb 11788429 11540364 1.02
tpcds_q54/duckdb:duckdb 17471384 16227327 1.08
tpcds_q55/duckdb:duckdb 7189387 6658059 1.08
tpcds_q56/duckdb:duckdb 13175424 12938930 1.02
tpcds_q57/duckdb:duckdb 31247120 30619668 1.02
tpcds_q58/duckdb:duckdb 11991579 11666096 1.03
tpcds_q59/duckdb:duckdb 34749426 34442309 1.01
tpcds_q60/duckdb:duckdb 15461094 15091048 1.02
tpcds_q61/duckdb:duckdb 14950710 13893523 1.08
tpcds_q62/duckdb:duckdb 9368082 8868883 1.06
tpcds_q63/duckdb:duckdb 11619121 10746967 1.08
tpcds_q64/duckdb:duckdb 53967908 50873379 1.06
tpcds_q65/duckdb:duckdb 33633177 32145813 1.05
tpcds_q66/duckdb:duckdb 25350688 23286396 1.09
tpcds_q67/duckdb:duckdb 131030121 128777753 1.02
tpcds_q68/duckdb:duckdb 24730914 24704154 1.00
tpcds_q69/duckdb:duckdb 25376283 24061540 1.05
tpcds_q70/duckdb:duckdb 🚨 15551779 13677371 1.14
tpcds_q71/duckdb:duckdb 12296872 12845044 0.96
tpcds_q72/duckdb:duckdb 42968713 42743130 1.01
tpcds_q73/duckdb:duckdb 10992355 10230585 1.07
tpcds_q74/duckdb:duckdb 97946776 96900687 1.01
tpcds_q75/duckdb:duckdb 42496803 42061792 1.01
tpcds_q76/duckdb:duckdb 12217588 11531641 1.06
tpcds_q77/duckdb:duckdb 12396101 11429208 1.08
tpcds_q78/duckdb:duckdb 64369874 62966709 1.02
tpcds_q79/duckdb:duckdb 17688565 17185601 1.03
tpcds_q80/duckdb:duckdb 🚨 29487337 25983558 1.13
tpcds_q81/duckdb:duckdb 38088634 35740352 1.07
tpcds_q82/duckdb:duckdb 8128854 8031904 1.01
tpcds_q83/duckdb:duckdb 9078316 8798905 1.03
tpcds_q84/duckdb:duckdb 13899461 12688504 1.10
tpcds_q85/duckdb:duckdb 24032148 22753805 1.06
tpcds_q86/duckdb:duckdb 10759800 10141115 1.06
tpcds_q87/duckdb:duckdb 32381955 31627975 1.02
tpcds_q88/duckdb:duckdb 24235301 24174755 1.00
tpcds_q89/duckdb:duckdb 13080780 12884446 1.02
tpcds_q90/duckdb:duckdb 5536236 5329262 1.04
tpcds_q91/duckdb:duckdb 12745298 12571148 1.01
tpcds_q92/duckdb:duckdb 🚨 9177442 8241822 1.11
tpcds_q93/duckdb:duckdb 21629933 20283517 1.07
tpcds_q94/duckdb:duckdb 13021650 12081705 1.08
tpcds_q95/duckdb:duckdb 🚨 130330501 107267313 1.22
tpcds_q96/duckdb:duckdb 4673224 4446443 1.05
tpcds_q97/duckdb:duckdb 🚨 32221707 29196667 1.10
tpcds_q98/duckdb:duckdb 13898327 13515014 1.03
tpcds_q99/duckdb:duckdb 16676141 16306562 1.02
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +2.3% +2.4% -0.0% +10.8% ➖ noise
1 datafusion:vortex-file-compressed +1.7% +2.4% -0.7% +11.1% ➖ noise
1 duckdb:duckdb +13.0% +2.4% +10.4% +13.8% ➖ noise
1 duckdb:vortex-compact +0.5% +2.4% -1.8% +13.1% ➖ noise
1 duckdb:vortex-file-compressed +3.6% +2.4% +1.2% +12.3% ➖ noise
2 datafusion:vortex-compact +0.0% +2.1% -2.0% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -3.4% +2.1% -5.4% +11.5% ➖ noise
2 duckdb:duckdb -0.1% +2.1% -2.1% +11.2% ➖ noise
2 duckdb:vortex-compact +1.2% +2.1% -0.8% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +1.5% +2.1% -0.6% +10.0% ➖ noise
3 datafusion:vortex-compact +2.4% +2.1% +0.3% +12.6% ➖ noise
3 datafusion:vortex-file-compressed +0.8% +2.1% -1.3% +10.2% ➖ noise
3 duckdb:duckdb +11.6% +2.1% +9.3% +16.2% ➖ noise
3 duckdb:vortex-compact -2.4% +2.1% -4.4% +14.3% ➖ noise
3 duckdb:vortex-file-compressed -1.0% +2.1% -3.0% +13.2% ➖ noise
4 datafusion:vortex-compact +3.9% +1.5% +2.3% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -3.6% +1.5% -5.1% +10.0% ➖ noise
4 duckdb:duckdb +1.1% +1.5% -0.4% +10.0% ➖ noise
4 duckdb:vortex-compact +5.8% +1.5% +4.2% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +6.0% +1.5% +4.3% +10.0% ➖ noise
5 datafusion:vortex-compact +2.8% +5.5% -2.5% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -5.4% +5.5% -10.3% +10.0% ✅ faster
5 duckdb:duckdb +3.2% +5.5% -2.2% +12.9% ➖ noise
5 duckdb:vortex-compact -2.0% +5.5% -7.0% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +6.3% +5.5% +0.8% +12.6% ➖ noise
6 datafusion:vortex-compact +6.4% +3.7% +2.6% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -1.3% +3.7% -4.8% +10.0% ➖ noise
6 duckdb:duckdb +5.8% +3.7% +2.0% +15.0% ➖ noise
6 duckdb:vortex-compact +3.3% +3.7% -0.4% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +4.9% +3.7% +1.1% +10.0% ➖ noise
7 datafusion:vortex-compact +0.9% +5.8% -4.7% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -6.5% +5.8% -11.6% +10.0% ✅ faster
7 duckdb:duckdb +18.2% +5.8% +11.7% +19.1% ➖ noise
7 duckdb:vortex-compact -2.3% +5.8% -7.6% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +3.8% +5.8% -1.9% +11.6% ➖ noise
8 datafusion:vortex-compact -2.1% +6.0% -7.7% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -0.9% +6.0% -6.6% +10.0% ➖ noise
8 duckdb:duckdb +2.6% +6.0% -3.3% +10.0% ➖ noise
8 duckdb:vortex-compact +4.0% +6.0% -1.9% +10.5% ➖ noise
8 duckdb:vortex-file-compressed +7.0% +6.0% +0.9% +10.6% ➖ noise
9 datafusion:vortex-compact +2.4% -4.7% +7.4% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -2.1% -4.7% +2.7% +10.0% ➖ noise
9 duckdb:duckdb +3.5% -4.7% +8.6% +10.0% ➖ noise
9 duckdb:vortex-compact +2.9% -4.7% +8.0% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +3.3% -4.7% +8.3% +10.0% ➖ noise
10 datafusion:vortex-compact +3.3% +4.5% -1.1% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -3.0% +4.5% -7.2% +10.0% ➖ noise
10 duckdb:duckdb +5.6% +4.5% +1.1% +10.0% ➖ noise
10 duckdb:vortex-compact +1.9% +4.5% -2.5% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +1.6% +4.5% -2.8% +10.0% ➖ noise
11 datafusion:vortex-compact +4.3% -0.9% +5.3% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -2.8% -0.9% -1.9% +10.0% ➖ noise
11 duckdb:duckdb +3.2% -0.9% +4.2% +10.0% ➖ noise
11 duckdb:vortex-compact +4.8% -0.9% +5.8% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +5.0% -0.9% +6.0% +10.0% ➖ noise
12 datafusion:vortex-compact +6.1% +6.0% +0.1% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -2.1% +6.0% -7.6% +13.5% ➖ noise
12 duckdb:duckdb +10.5% +6.0% +4.2% +14.3% ➖ noise
12 duckdb:vortex-compact +6.2% +6.0% +0.2% +13.3% ➖ noise
12 duckdb:vortex-file-compressed +5.8% +6.0% -0.2% +10.2% ➖ noise
13 datafusion:vortex-compact +8.4% +5.1% +3.1% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -5.6% +5.1% -10.1% +10.0% ✅ faster
13 duckdb:duckdb +7.8% +5.1% +2.6% +10.0% ➖ noise
13 duckdb:vortex-compact +2.2% +5.1% -2.7% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -0.1% +5.1% -4.9% +10.0% ➖ noise
14 datafusion:vortex-compact +4.0% +1.7% +2.2% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -3.7% +1.7% -5.4% +10.0% ➖ noise
14 duckdb:duckdb +5.9% +1.7% +4.1% +10.0% ➖ noise
14 duckdb:vortex-compact -2.0% +1.7% -3.7% +11.3% ➖ noise
14 duckdb:vortex-file-compressed -2.9% +1.7% -4.6% +13.8% ➖ noise
15 datafusion:vortex-compact +5.2% +2.7% +2.4% +10.3% ➖ noise
15 datafusion:vortex-file-compressed -1.4% +2.7% -4.0% +11.1% ➖ noise
15 duckdb:duckdb +7.0% +2.7% +4.1% +14.0% ➖ noise
15 duckdb:vortex-compact +3.4% +2.7% +0.6% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +3.8% +2.7% +1.0% +10.0% ➖ noise
16 datafusion:vortex-compact +5.3% +5.3% -0.0% +11.8% ➖ noise
16 datafusion:vortex-file-compressed +2.4% +5.3% -2.8% +10.0% ➖ noise
16 duckdb:duckdb +14.4% +5.3% +8.6% +13.1% ➖ noise
16 duckdb:vortex-compact -2.8% +5.3% -7.7% +13.4% ➖ noise
16 duckdb:vortex-file-compressed +5.4% +5.3% +0.1% +10.0% ➖ noise
17 datafusion:vortex-compact +5.1% +4.9% +0.2% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -1.3% +4.9% -5.9% +10.0% ➖ noise
17 duckdb:duckdb -1.4% +4.9% -6.0% +13.0% ➖ noise
17 duckdb:vortex-compact +0.2% +4.9% -4.5% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +4.1% +4.9% -0.7% +11.5% ➖ noise
18 datafusion:vortex-compact +3.8% +1.0% +2.8% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -2.4% +1.0% -3.3% +10.0% ➖ noise
18 duckdb:duckdb +8.4% +1.0% +7.3% +10.0% ➖ noise
18 duckdb:vortex-compact +0.7% +1.0% -0.2% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +7.8% +1.0% +6.8% +10.0% ➖ noise
19 datafusion:vortex-compact +4.6% -0.7% +5.4% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -4.4% -0.7% -3.7% +10.0% ➖ noise
19 duckdb:duckdb +7.0% -0.7% +7.8% +13.6% ➖ noise
19 duckdb:vortex-compact +2.5% -0.7% +3.2% +11.9% ➖ noise
19 duckdb:vortex-file-compressed +5.7% -0.7% +6.5% +11.2% ➖ noise
20 datafusion:vortex-compact +3.4% +4.1% -0.7% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +4.0% +4.1% -0.1% +10.0% ➖ noise
20 duckdb:duckdb +3.0% +4.1% -1.1% +12.4% ➖ noise
20 duckdb:vortex-compact +4.4% +4.1% +0.3% +13.9% ➖ noise
20 duckdb:vortex-file-compressed -0.7% +4.1% -4.6% +11.9% ➖ noise
21 datafusion:vortex-compact +8.7% -1.2% +10.0% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +0.5% -1.2% +1.6% +10.0% ➖ noise
21 duckdb:duckdb -0.9% -1.2% +0.3% +21.1% ➖ noise
21 duckdb:vortex-compact -0.1% -1.2% +1.0% +17.7% ➖ noise
21 duckdb:vortex-file-compressed -5.3% -1.2% -4.2% +13.7% ➖ noise
22 datafusion:vortex-compact +3.7% +2.9% +0.8% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -3.9% +2.9% -6.6% +10.6% ➖ noise
22 duckdb:duckdb +11.9% +2.9% +8.8% +10.7% ➖ noise
22 duckdb:vortex-compact +2.0% +2.9% -0.8% +10.0% ➖ noise
22 duckdb:vortex-file-compressed +0.1% +2.9% -2.7% +10.0% ➖ noise
23 datafusion:vortex-compact +6.2% +1.9% +4.3% +10.0% ➖ noise
23 datafusion:vortex-file-compressed -2.2% +1.9% -4.0% +10.0% ➖ noise
23 duckdb:duckdb -4.6% +1.9% -6.3% +13.9% ➖ noise
23 duckdb:vortex-compact +2.1% +1.9% +0.2% +13.3% ➖ noise
23 duckdb:vortex-file-compressed -1.3% +1.9% -3.1% +10.0% ➖ noise
24 datafusion:vortex-compact +3.1% +3.5% -0.4% +10.0% ➖ noise
24 datafusion:vortex-file-compressed +3.8% +3.5% +0.2% +10.0% ➖ noise
24 duckdb:duckdb +10.1% +3.5% +6.3% +19.6% ➖ noise
24 duckdb:vortex-compact +4.8% +3.5% +1.2% +10.0% ➖ noise
24 duckdb:vortex-file-compressed +1.9% +3.5% -1.5% +10.0% ➖ noise
25 datafusion:vortex-compact +1.7% +2.8% -1.0% +10.0% ➖ noise
25 datafusion:vortex-file-compressed -0.5% +2.8% -3.2% +10.0% ➖ noise
25 duckdb:duckdb +1.4% +2.8% -1.3% +14.6% ➖ noise
25 duckdb:vortex-compact +4.1% +2.8% +1.3% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +0.9% +2.8% -1.8% +10.0% ➖ noise
26 datafusion:vortex-compact +0.6% -0.5% +1.1% +10.0% ➖ noise
26 datafusion:vortex-file-compressed +0.8% -0.5% +1.3% +10.0% ➖ noise
26 duckdb:duckdb -1.3% -0.5% -0.8% +15.1% ➖ noise
26 duckdb:vortex-compact +6.3% -0.5% +6.9% +10.0% ➖ noise
26 duckdb:vortex-file-compressed +5.0% -0.5% +5.5% +10.7% ➖ noise
27 datafusion:vortex-compact +5.3% +1.5% +3.8% +10.0% ➖ noise
27 datafusion:vortex-file-compressed +0.4% +1.5% -1.0% +10.0% ➖ noise
27 duckdb:duckdb +5.2% +1.5% +3.7% +18.8% ➖ noise
27 duckdb:vortex-compact +5.3% +1.5% +3.8% +10.0% ➖ noise
27 duckdb:vortex-file-compressed -0.8% +1.5% -2.2% +10.0% ➖ noise
28 datafusion:vortex-compact +2.0% -0.7% +2.7% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -0.1% -0.7% +0.6% +10.0% ➖ noise
28 duckdb:duckdb +2.7% -0.7% +3.5% +10.0% ➖ noise
28 duckdb:vortex-compact +4.5% -0.7% +5.3% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +0.2% -0.7% +1.0% +10.0% ➖ noise
29 datafusion:vortex-compact +6.0% +1.9% +4.1% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -3.5% +1.9% -5.2% +10.0% ➖ noise
29 duckdb:duckdb +4.1% +1.9% +2.2% +10.0% ➖ noise
29 duckdb:vortex-compact +8.5% +1.9% +6.5% +10.0% ➖ noise
29 duckdb:vortex-file-compressed -0.9% +1.9% -2.7% +10.7% ➖ noise
30 datafusion:vortex-compact +2.8% +3.3% -0.6% +10.1% ➖ noise
30 datafusion:vortex-file-compressed +3.1% +3.3% -0.2% +11.1% ➖ noise
30 duckdb:duckdb -8.7% +3.3% -11.6% +12.3% ✅ faster
30 duckdb:vortex-compact +4.9% +3.3% +1.5% +11.2% ➖ noise
30 duckdb:vortex-file-compressed -2.8% +3.3% -6.0% +12.5% ➖ noise
31 datafusion:vortex-compact +5.1% +4.1% +0.9% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +0.7% +4.1% -3.3% +10.0% ➖ noise
31 duckdb:duckdb -0.6% +4.1% -4.5% +14.0% ➖ noise
31 duckdb:vortex-compact +10.9% +4.1% +6.5% +10.0% ➖ noise
31 duckdb:vortex-file-compressed +4.0% +4.1% -0.1% +10.0% ➖ noise
32 datafusion:vortex-compact +5.3% +0.3% +5.0% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +2.8% +0.3% +2.6% +10.0% ➖ noise
32 duckdb:duckdb +17.9% +0.3% +17.6% +14.6% 🚨 regression
32 duckdb:vortex-compact +3.4% +0.3% +3.1% +10.0% ➖ noise
32 duckdb:vortex-file-compressed +3.3% +0.3% +3.0% +10.8% ➖ noise
33 datafusion:vortex-compact +0.5% -0.1% +0.6% +10.0% ➖ noise
33 datafusion:vortex-file-compressed +2.8% -0.1% +2.9% +10.0% ➖ noise
33 duckdb:duckdb +10.6% -0.1% +10.7% +10.0% 🚨 regression
33 duckdb:vortex-compact -0.3% -0.1% -0.2% +10.0% ➖ noise
33 duckdb:vortex-file-compressed -1.4% -0.1% -1.3% +11.2% ➖ noise
34 datafusion:vortex-compact +2.9% +6.4% -3.3% +11.4% ➖ noise
34 datafusion:vortex-file-compressed +2.9% +6.4% -3.3% +10.0% ➖ noise
34 duckdb:duckdb +6.9% +6.4% +0.5% +12.2% ➖ noise
34 duckdb:vortex-compact +0.4% +6.4% -5.6% +10.0% ➖ noise
34 duckdb:vortex-file-compressed +2.9% +6.4% -3.2% +18.8% ➖ noise
35 datafusion:vortex-compact +5.9% +2.5% +3.4% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -0.4% +2.5% -2.8% +10.0% ➖ noise
35 duckdb:duckdb +5.7% +2.5% +3.1% +14.8% ➖ noise
35 duckdb:vortex-compact +12.1% +2.5% +9.4% +10.0% ➖ noise
35 duckdb:vortex-file-compressed +0.8% +2.5% -1.6% +11.3% ➖ noise
36 datafusion:vortex-compact +2.9% +2.0% +0.8% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +0.1% +2.0% -1.9% +10.0% ➖ noise
36 duckdb:duckdb +8.4% +2.0% +6.3% +10.0% ➖ noise
36 duckdb:vortex-compact +1.8% +2.0% -0.3% +10.0% ➖ noise
36 duckdb:vortex-file-compressed +3.7% +2.0% +1.6% +16.8% ➖ noise
37 datafusion:vortex-compact +6.3% +2.7% +3.5% +10.0% ➖ noise
37 datafusion:vortex-file-compressed -3.1% +2.7% -5.6% +13.2% ➖ noise
37 duckdb:duckdb -1.2% +2.7% -3.7% +14.9% ➖ noise
37 duckdb:vortex-compact +8.7% +2.7% +5.9% +10.0% ➖ noise
37 duckdb:vortex-file-compressed +3.9% +2.7% +1.2% +10.1% ➖ noise
38 datafusion:vortex-compact +2.1% +0.9% +1.2% +10.0% ➖ noise
38 datafusion:vortex-file-compressed -1.2% +0.9% -2.2% +10.0% ➖ noise
38 duckdb:duckdb +4.9% +0.9% +3.9% +10.0% ➖ noise
38 duckdb:vortex-compact +6.0% +0.9% +5.0% +12.8% ➖ noise
38 duckdb:vortex-file-compressed +2.8% +0.9% +1.8% +20.3% ➖ noise
39 datafusion:vortex-compact -2.1% +3.4% -5.3% +13.2% ➖ noise
39 datafusion:vortex-file-compressed +7.7% +3.4% +4.2% +12.6% ➖ noise
39 duckdb:duckdb +0.1% +3.4% -3.2% +25.5% ➖ noise
39 duckdb:vortex-compact +2.1% +3.4% -1.2% +12.4% ➖ noise
39 duckdb:vortex-file-compressed -7.4% +3.4% -10.4% +21.5% ➖ noise
40 datafusion:vortex-compact +4.9% +3.3% +1.6% +10.0% ➖ noise
40 datafusion:vortex-file-compressed -3.3% +3.3% -6.4% +10.0% ➖ noise
40 duckdb:duckdb +6.6% +3.3% +3.2% +16.3% ➖ noise
40 duckdb:vortex-compact +5.8% +3.3% +2.5% +11.8% ➖ noise
40 duckdb:vortex-file-compressed +2.4% +3.3% -0.8% +13.8% ➖ noise
41 datafusion:vortex-compact +5.5% +5.4% +0.1% +11.5% ➖ noise
41 datafusion:vortex-file-compressed +2.9% +5.4% -2.4% +10.0% ➖ noise
41 duckdb:duckdb +3.8% +5.4% -1.5% +10.0% ➖ noise
41 duckdb:vortex-compact +11.3% +5.4% +5.6% +12.4% ➖ noise
41 duckdb:vortex-file-compressed +3.2% +5.4% -2.1% +10.0% ➖ noise
42 datafusion:vortex-compact +2.8% +2.5% +0.3% +10.0% ➖ noise
42 datafusion:vortex-file-compressed +3.2% +2.5% +0.7% +11.3% ➖ noise
42 duckdb:duckdb -3.2% +2.5% -5.5% +14.6% ➖ noise
42 duckdb:vortex-compact +8.1% +2.5% +5.5% +14.0% ➖ noise
42 duckdb:vortex-file-compressed -3.4% +2.5% -5.8% +11.7% ➖ noise
43 datafusion:vortex-compact -1.2% +5.9% -6.7% +10.0% ➖ noise
43 datafusion:vortex-file-compressed +4.4% +5.9% -1.4% +10.0% ➖ noise
43 duckdb:duckdb +6.2% +5.9% +0.3% +10.0% ➖ noise
43 duckdb:vortex-compact +8.2% +5.9% +2.3% +10.0% ➖ noise
43 duckdb:vortex-file-compressed +0.5% +5.9% -5.1% +10.0% ➖ noise
44 datafusion:vortex-compact +2.5% -0.8% +3.3% +10.0% ➖ noise
44 datafusion:vortex-file-compressed -3.9% -0.8% -3.2% +10.0% ➖ noise
44 duckdb:duckdb +2.7% -0.8% +3.5% +10.0% ➖ noise
44 duckdb:vortex-compact +2.1% -0.8% +2.9% +19.5% ➖ noise
44 duckdb:vortex-file-compressed +9.4% -0.8% +10.3% +10.0% 🚨 regression
45 datafusion:vortex-compact +3.1% +5.1% -1.9% +10.0% ➖ noise
45 datafusion:vortex-file-compressed +2.1% +5.1% -2.8% +10.0% ➖ noise
45 duckdb:duckdb +4.0% +5.1% -1.0% +10.7% ➖ noise
45 duckdb:vortex-compact +6.2% +5.1% +1.1% +11.8% ➖ noise
45 duckdb:vortex-file-compressed +4.5% +5.1% -0.5% +10.0% ➖ noise
46 datafusion:vortex-compact -1.6% +3.0% -4.5% +10.0% ➖ noise
46 datafusion:vortex-file-compressed +4.3% +3.0% +1.2% +10.0% ➖ noise
46 duckdb:duckdb +3.9% +3.0% +0.9% +10.0% ➖ noise
46 duckdb:vortex-compact +2.5% +3.0% -0.5% +10.0% ➖ noise
46 duckdb:vortex-file-compressed +3.0% +3.0% -0.1% +10.0% ➖ noise
47 datafusion:vortex-compact +3.8% +2.4% +1.4% +10.0% ➖ noise
47 datafusion:vortex-file-compressed +1.8% +2.4% -0.6% +10.0% ➖ noise
47 duckdb:duckdb +1.5% +2.4% -0.8% +10.0% ➖ noise
47 duckdb:vortex-compact +2.4% +2.4% +0.1% +10.0% ➖ noise
47 duckdb:vortex-file-compressed +2.6% +2.4% +0.3% +12.5% ➖ noise
48 datafusion:vortex-compact -1.3% +1.6% -2.9% +10.0% ➖ noise
48 datafusion:vortex-file-compressed +1.5% +1.6% -0.0% +10.0% ➖ noise
48 duckdb:duckdb +2.5% +1.6% +0.9% +21.1% ➖ noise
48 duckdb:vortex-compact +8.7% +1.6% +7.0% +10.0% ➖ noise
48 duckdb:vortex-file-compressed +4.0% +1.6% +2.4% +10.0% ➖ noise
49 datafusion:vortex-compact +5.1% +1.0% +4.1% +10.0% ➖ noise
49 datafusion:vortex-file-compressed -0.5% +1.0% -1.5% +10.0% ➖ noise
49 duckdb:duckdb +3.6% +1.0% +2.6% +15.8% ➖ noise
49 duckdb:vortex-compact +1.3% +1.0% +0.3% +10.0% ➖ noise
49 duckdb:vortex-file-compressed -0.4% +1.0% -1.4% +12.0% ➖ noise
50 datafusion:vortex-compact +2.1% +2.7% -0.6% +10.0% ➖ noise
50 datafusion:vortex-file-compressed +1.1% +2.7% -1.6% +10.0% ➖ noise
50 duckdb:duckdb -0.3% +2.7% -3.0% +10.0% ➖ noise
50 duckdb:vortex-compact +3.7% +2.7% +0.9% +10.0% ➖ noise
50 duckdb:vortex-file-compressed +3.3% +2.7% +0.6% +10.0% ➖ noise
51 datafusion:vortex-compact +2.3% +3.0% -0.6% +10.4% ➖ noise
51 datafusion:vortex-file-compressed +4.1% +3.0% +1.1% +10.4% ➖ noise
51 duckdb:duckdb +3.1% +3.0% +0.1% +22.4% ➖ noise
51 duckdb:vortex-compact +1.1% +3.0% -1.8% +13.0% ➖ noise
51 duckdb:vortex-file-compressed +2.0% +3.0% -1.0% +21.7% ➖ noise
52 datafusion:vortex-compact +2.4% +1.8% +0.6% +12.7% ➖ noise
52 datafusion:vortex-file-compressed +0.7% +1.8% -1.1% +14.8% ➖ noise
52 duckdb:duckdb +1.2% +1.8% -0.5% +15.3% ➖ noise
52 duckdb:vortex-compact +6.2% +1.8% +4.4% +17.2% ➖ noise
52 duckdb:vortex-file-compressed +5.6% +1.8% +3.8% +22.8% ➖ noise
53 datafusion:vortex-compact +5.3% +4.3% +1.0% +10.0% ➖ noise
53 datafusion:vortex-file-compressed +1.5% +4.3% -2.6% +10.0% ➖ noise
53 duckdb:duckdb +2.1% +4.3% -2.0% +10.2% ➖ noise
53 duckdb:vortex-compact +1.1% +4.3% -3.0% +13.2% ➖ noise
53 duckdb:vortex-file-compressed +1.8% +4.3% -2.3% +10.0% ➖ noise
54 datafusion:vortex-compact +7.2% +6.5% +0.7% +12.5% ➖ noise
54 datafusion:vortex-file-compressed +3.7% +6.5% -2.6% +10.0% ➖ noise
54 duckdb:duckdb +7.7% +6.5% +1.1% +12.2% ➖ noise
54 duckdb:vortex-compact +1.2% +6.5% -5.0% +10.0% ➖ noise
54 duckdb:vortex-file-compressed -4.4% +6.5% -10.2% +10.0% ✅ faster
55 datafusion:vortex-compact +8.3% +5.7% +2.5% +10.7% ➖ noise
55 datafusion:vortex-file-compressed -0.9% +5.7% -6.3% +11.0% ➖ noise
55 duckdb:duckdb +8.0% +5.7% +2.1% +28.6% ➖ noise
55 duckdb:vortex-compact +10.5% +5.7% +4.5% +10.7% ➖ noise
55 duckdb:vortex-file-compressed +4.2% +5.7% -1.5% +15.5% ➖ noise
56 datafusion:vortex-compact +4.1% +0.7% +3.4% +14.0% ➖ noise
56 datafusion:vortex-file-compressed +7.6% +0.7% +6.8% +10.0% ➖ noise
56 duckdb:duckdb +1.8% +0.7% +1.1% +12.2% ➖ noise
56 duckdb:vortex-compact -0.3% +0.7% -0.9% +10.0% ➖ noise
56 duckdb:vortex-file-compressed -0.9% +0.7% -1.6% +10.0% ➖ noise
57 datafusion:vortex-compact +6.7% +1.9% +4.8% +10.0% ➖ noise
57 datafusion:vortex-file-compressed +6.0% +1.9% +4.1% +10.0% ➖ noise
57 duckdb:duckdb +2.0% +1.9% +0.2% +10.0% ➖ noise
57 duckdb:vortex-compact +2.0% +1.9% +0.1% +10.0% ➖ noise
57 duckdb:vortex-file-compressed +1.0% +1.9% -0.9% +12.0% ➖ noise
58 datafusion:vortex-compact +4.7% +3.1% +1.6% +10.0% ➖ noise
58 datafusion:vortex-file-compressed +7.2% +3.1% +4.0% +10.0% ➖ noise
58 duckdb:duckdb +2.8% +3.1% -0.3% +17.0% ➖ noise
58 duckdb:vortex-compact +1.2% +3.1% -1.9% +20.9% ➖ noise
58 duckdb:vortex-file-compressed +4.3% +3.1% +1.1% +17.8% ➖ noise
59 datafusion:vortex-compact +4.4% +1.9% +2.4% +10.0% ➖ noise
59 datafusion:vortex-file-compressed +1.3% +1.9% -0.6% +10.0% ➖ noise
59 duckdb:duckdb +0.9% +1.9% -1.0% +10.0% ➖ noise
59 duckdb:vortex-compact +3.6% +1.9% +1.6% +10.0% ➖ noise
59 duckdb:vortex-file-compressed +2.5% +1.9% +0.6% +10.0% ➖ noise
60 datafusion:vortex-compact +4.6% +7.4% -2.6% +10.0% ➖ noise
60 datafusion:vortex-file-compressed +0.3% +7.4% -6.6% +11.9% ➖ noise
60 duckdb:duckdb +2.5% +7.4% -4.6% +12.8% ➖ noise
60 duckdb:vortex-compact +3.5% +7.4% -3.7% +10.0% ➖ noise
60 duckdb:vortex-file-compressed +5.2% +7.4% -2.0% +11.2% ➖ noise
61 datafusion:vortex-compact +2.0% +4.2% -2.1% +10.0% ➖ noise
61 datafusion:vortex-file-compressed -6.7% +4.2% -10.4% +10.0% ✅ faster
61 duckdb:duckdb +7.6% +4.2% +3.3% +12.4% ➖ noise
61 duckdb:vortex-compact +8.0% +4.2% +3.7% +10.0% ➖ noise
61 duckdb:vortex-file-compressed -5.8% +4.2% -9.6% +12.9% ➖ noise
62 datafusion:vortex-compact +5.4% +4.1% +1.2% +12.9% ➖ noise
62 datafusion:vortex-file-compressed -0.2% +4.1% -4.2% +11.3% ➖ noise
62 duckdb:duckdb +5.6% +4.1% +1.4% +10.5% ➖ noise
62 duckdb:vortex-compact +2.2% +4.1% -1.9% +20.1% ➖ noise
62 duckdb:vortex-file-compressed +4.2% +4.1% +0.0% +18.0% ➖ noise
63 datafusion:vortex-compact +2.5% +2.7% -0.1% +10.0% ➖ noise
63 datafusion:vortex-file-compressed -1.5% +2.7% -4.0% +10.0% ➖ noise
63 duckdb:duckdb +8.1% +2.7% +5.3% +14.6% ➖ noise
63 duckdb:vortex-compact +10.0% +2.7% +7.2% +10.0% ➖ noise
63 duckdb:vortex-file-compressed -1.1% +2.7% -3.7% +10.0% ➖ noise
64 datafusion:vortex-compact +4.3% +4.4% -0.1% +10.0% ➖ noise
64 datafusion:vortex-file-compressed -1.4% +4.4% -5.6% +10.0% ➖ noise
64 duckdb:duckdb +6.1% +4.4% +1.6% +10.0% ➖ noise
64 duckdb:vortex-compact +3.6% +4.4% -0.8% +10.0% ➖ noise
64 duckdb:vortex-file-compressed +1.7% +4.4% -2.6% +10.0% ➖ noise
65 datafusion:vortex-compact -0.2% +1.1% -1.3% +10.0% ➖ noise
65 datafusion:vortex-file-compressed -4.6% +1.1% -5.5% +12.1% ➖ noise
65 duckdb:duckdb +4.6% +1.1% +3.5% +14.2% ➖ noise
65 duckdb:vortex-compact +1.5% +1.1% +0.4% +14.6% ➖ noise
65 duckdb:vortex-file-compressed +2.9% +1.1% +1.8% +13.2% ➖ noise
66 datafusion:vortex-compact +2.6% +1.1% +1.4% +10.0% ➖ noise
66 datafusion:vortex-file-compressed -6.2% +1.1% -7.3% +10.0% ➖ noise
66 duckdb:duckdb +8.9% +1.1% +7.6% +10.3% ➖ noise
66 duckdb:vortex-compact +9.5% +1.1% +8.2% +10.4% ➖ noise
66 duckdb:vortex-file-compressed +4.1% +1.1% +2.9% +17.2% ➖ noise
67 datafusion:vortex-compact +3.2% +4.2% -1.0% +10.0% ➖ noise
67 datafusion:vortex-file-compressed -6.1% +4.2% -9.9% +10.0% ✅ faster
67 duckdb:duckdb +1.7% +4.2% -2.4% +10.0% ➖ noise
67 duckdb:vortex-compact +0.2% +4.2% -3.9% +10.0% ➖ noise
67 duckdb:vortex-file-compressed +5.2% +4.2% +1.0% +10.0% ➖ noise
68 datafusion:vortex-compact +5.8% +0.1% +5.6% +10.0% ➖ noise
68 datafusion:vortex-file-compressed -1.6% +0.1% -1.7% +10.0% ➖ noise
68 duckdb:duckdb +0.1% +0.1% -0.0% +10.0% ➖ noise
68 duckdb:vortex-compact +1.8% +0.1% +1.6% +10.0% ➖ noise
68 duckdb:vortex-file-compressed -1.2% +0.1% -1.3% +10.0% ➖ noise
69 datafusion:vortex-compact +2.6% +0.3% +2.4% +10.0% ➖ noise
69 datafusion:vortex-file-compressed +2.0% +0.3% +1.7% +10.0% ➖ noise
69 duckdb:duckdb +5.5% +0.3% +5.2% +10.0% ➖ noise
69 duckdb:vortex-compact +5.0% +0.3% +4.7% +10.0% ➖ noise
69 duckdb:vortex-file-compressed +3.5% +0.3% +3.2% +10.0% ➖ noise
70 datafusion:vortex-compact +2.2% +1.1% +1.2% +10.0% ➖ noise
70 datafusion:vortex-file-compressed -1.1% +1.1% -2.2% +10.0% ➖ noise
70 duckdb:duckdb +13.7% +1.1% +12.5% +16.8% ➖ noise
70 duckdb:vortex-compact +7.1% +1.1% +6.0% +10.2% ➖ noise
70 duckdb:vortex-file-compressed -1.1% +1.1% -2.1% +10.1% ➖ noise
71 datafusion:vortex-compact +0.8% +3.3% -2.4% +10.0% ➖ noise
71 datafusion:vortex-file-compressed -8.3% +3.3% -11.2% +10.0% ✅ faster
71 duckdb:duckdb -4.3% +3.3% -7.3% +12.5% ➖ noise
71 duckdb:vortex-compact +9.6% +3.3% +6.1% +22.8% ➖ noise
71 duckdb:vortex-file-compressed +0.8% +3.3% -2.4% +14.5% ➖ noise
72 datafusion:vortex-compact +5.1% +2.4% +2.6% +10.0% ➖ noise
72 datafusion:vortex-file-compressed -0.8% +2.4% -3.2% +10.0% ➖ noise
72 duckdb:duckdb +0.5% +2.4% -1.9% +10.3% ➖ noise
72 duckdb:vortex-compact +1.2% +2.4% -1.2% +10.0% ➖ noise
72 duckdb:vortex-file-compressed +0.1% +2.4% -2.3% +10.0% ➖ noise
73 datafusion:vortex-compact -2.0% +0.8% -2.7% +18.3% ➖ noise
73 datafusion:vortex-file-compressed -6.5% +0.8% -7.2% +25.2% ➖ noise
73 duckdb:duckdb +7.4% +0.8% +6.6% +11.3% ➖ noise
73 duckdb:vortex-compact +1.1% +0.8% +0.3% +10.0% ➖ noise
73 duckdb:vortex-file-compressed +2.8% +0.8% +2.1% +10.0% ➖ noise
74 datafusion:vortex-compact +3.4% +1.8% +1.6% +10.0% ➖ noise
74 datafusion:vortex-file-compressed +2.8% +1.8% +1.0% +10.0% ➖ noise
74 duckdb:duckdb +1.1% +1.8% -0.7% +10.0% ➖ noise
74 duckdb:vortex-compact +2.6% +1.8% +0.8% +10.0% ➖ noise
74 duckdb:vortex-file-compressed +1.2% +1.8% -0.6% +10.0% ➖ noise
75 datafusion:vortex-compact +4.8% +1.7% +3.1% +10.0% ➖ noise
75 datafusion:vortex-file-compressed +3.8% +1.7% +2.1% +10.0% ➖ noise
75 duckdb:duckdb +1.0% +1.7% -0.6% +10.6% ➖ noise
75 duckdb:vortex-compact +2.6% +1.7% +0.9% +10.7% ➖ noise
75 duckdb:vortex-file-compressed +5.9% +1.7% +4.2% +10.0% ➖ noise
76 datafusion:vortex-compact +1.1% -0.7% +1.9% +10.0% ➖ noise
76 datafusion:vortex-file-compressed +4.8% -0.7% +5.5% +10.0% ➖ noise
76 duckdb:duckdb +5.9% -0.7% +6.7% +16.3% ➖ noise
76 duckdb:vortex-compact +7.3% -0.7% +8.1% +10.0% ➖ noise
76 duckdb:vortex-file-compressed -4.4% -0.7% -3.7% +17.0% ➖ noise
77 datafusion:vortex-compact +1.2% -2.0% +3.3% +10.0% ➖ noise
77 datafusion:vortex-file-compressed -0.8% -2.0% +1.3% +10.1% ➖ noise
77 duckdb:duckdb +8.5% -2.0% +10.7% +14.9% ➖ noise
77 duckdb:vortex-compact +1.4% -2.0% +3.5% +10.4% ➖ noise
77 duckdb:vortex-file-compressed -1.3% -2.0% +0.8% +14.2% ➖ noise
78 datafusion:vortex-compact +3.1% +1.6% +1.5% +10.0% ➖ noise
78 datafusion:vortex-file-compressed +3.5% +1.6% +1.8% +10.0% ➖ noise
78 duckdb:duckdb +2.2% +1.6% +0.6% +10.9% ➖ noise
78 duckdb:vortex-compact +0.1% +1.6% -1.4% +10.0% ➖ noise
78 duckdb:vortex-file-compressed +4.2% +1.6% +2.6% +10.0% ➖ noise
79 datafusion:vortex-compact +2.7% -2.0% +4.8% +10.6% ➖ noise
79 datafusion:vortex-file-compressed +1.9% -2.0% +4.0% +10.5% ➖ noise
79 duckdb:duckdb +2.9% -2.0% +5.1% +10.6% ➖ noise
79 duckdb:vortex-compact -1.1% -2.0% +0.9% +13.3% ➖ noise
79 duckdb:vortex-file-compressed +2.0% -2.0% +4.1% +13.6% ➖ noise
80 datafusion:vortex-compact +6.8% +1.2% +5.5% +10.0% ➖ noise
80 datafusion:vortex-file-compressed +2.7% +1.2% +1.5% +10.0% ➖ noise
80 duckdb:duckdb +13.5% +1.2% +12.1% +20.6% ➖ noise
80 duckdb:vortex-compact +1.7% +1.2% +0.4% +10.0% ➖ noise
80 duckdb:vortex-file-compressed -3.3% +1.2% -4.5% +10.0% ➖ noise
81 datafusion:vortex-compact +3.7% +1.3% +2.3% +12.7% ➖ noise
81 datafusion:vortex-file-compressed +1.9% +1.3% +0.5% +16.6% ➖ noise
81 duckdb:duckdb +6.6% +1.3% +5.2% +10.0% ➖ noise
81 duckdb:vortex-compact +12.2% +1.3% +10.7% +13.5% ➖ noise
81 duckdb:vortex-file-compressed +4.3% +1.3% +3.0% +10.7% ➖ noise
82 datafusion:vortex-compact +0.1% -0.1% +0.1% +10.0% ➖ noise
82 datafusion:vortex-file-compressed +5.3% -0.1% +5.4% +10.2% ➖ noise
82 duckdb:duckdb +1.2% -0.1% +1.3% +14.4% ➖ noise
82 duckdb:vortex-compact +7.9% -0.1% +8.0% +10.0% ➖ noise
82 duckdb:vortex-file-compressed +6.8% -0.1% +6.9% +14.0% ➖ noise
83 datafusion:vortex-compact +2.0% +1.4% +0.6% +10.0% ➖ noise
83 datafusion:vortex-file-compressed -0.2% +1.4% -1.6% +10.0% ➖ noise
83 duckdb:duckdb +3.2% +1.4% +1.7% +12.3% ➖ noise
83 duckdb:vortex-compact +5.8% +1.4% +4.3% +10.0% ➖ noise
83 duckdb:vortex-file-compressed +2.0% +1.4% +0.6% +10.8% ➖ noise
84 datafusion:vortex-compact -0.7% -2.3% +1.6% +10.5% ➖ noise
84 datafusion:vortex-file-compressed +1.4% -2.3% +3.8% +10.5% ➖ noise
84 duckdb:duckdb +9.5% -2.3% +12.1% +11.3% 🚨 regression
84 duckdb:vortex-compact +3.1% -2.3% +5.5% +10.0% ➖ noise
84 duckdb:vortex-file-compressed +8.7% -2.3% +11.3% +10.0% 🚨 regression
85 datafusion:vortex-compact +1.6% +2.6% -1.0% +10.0% ➖ noise
85 datafusion:vortex-file-compressed +5.0% +2.6% +2.3% +10.0% ➖ noise
85 duckdb:duckdb +5.6% +2.6% +2.9% +10.0% ➖ noise
85 duckdb:vortex-compact +1.6% +2.6% -1.0% +10.5% ➖ noise
85 duckdb:vortex-file-compressed +5.3% +2.6% +2.6% +10.0% ➖ noise
86 datafusion:vortex-compact +6.5% +3.3% +3.1% +12.9% ➖ noise
86 datafusion:vortex-file-compressed +10.3% +3.3% +6.8% +13.4% ➖ noise
86 duckdb:duckdb +6.1% +3.3% +2.7% +13.9% ➖ noise
86 duckdb:vortex-compact -0.2% +3.3% -3.4% +15.7% ➖ noise
86 duckdb:vortex-file-compressed +4.3% +3.3% +0.9% +23.5% ➖ noise
87 datafusion:vortex-compact +2.9% -2.5% +5.5% +10.0% ➖ noise
87 datafusion:vortex-file-compressed -1.7% -2.5% +0.8% +10.0% ➖ noise
87 duckdb:duckdb +2.4% -2.5% +5.0% +13.2% ➖ noise
87 duckdb:vortex-compact -1.1% -2.5% +1.4% +11.3% ➖ noise
87 duckdb:vortex-file-compressed +8.1% -2.5% +10.9% +16.2% ➖ noise
88 datafusion:vortex-compact +1.0% +1.9% -0.8% +10.0% ➖ noise
88 datafusion:vortex-file-compressed +0.8% +1.9% -1.1% +10.0% ➖ noise
88 duckdb:duckdb +0.3% +1.9% -1.6% +15.3% ➖ noise
88 duckdb:vortex-compact +6.2% +1.9% +4.3% +14.0% ➖ noise
88 duckdb:vortex-file-compressed +8.2% +1.9% +6.2% +15.4% ➖ noise
89 datafusion:vortex-compact +6.3% +1.7% +4.5% +10.0% ➖ noise
89 datafusion:vortex-file-compressed +4.9% +1.7% +3.1% +12.1% ➖ noise
89 duckdb:duckdb +1.5% +1.7% -0.2% +11.8% ➖ noise
89 duckdb:vortex-compact +5.0% +1.7% +3.2% +10.0% ➖ noise
89 duckdb:vortex-file-compressed +4.2% +1.7% +2.4% +28.5% ➖ noise
90 datafusion:vortex-compact +0.5% +3.5% -2.9% +10.0% ➖ noise
90 datafusion:vortex-file-compressed +2.0% +3.5% -1.4% +10.0% ➖ noise
90 duckdb:duckdb +3.9% +3.5% +0.4% +13.0% ➖ noise
90 duckdb:vortex-compact +5.3% +3.5% +1.8% +10.2% ➖ noise
90 duckdb:vortex-file-compressed -1.0% +3.5% -4.3% +11.5% ➖ noise
91 datafusion:vortex-compact +3.9% -4.7% +9.0% +12.6% ➖ noise
91 datafusion:vortex-file-compressed -6.1% -4.7% -1.5% +12.6% ➖ noise
91 duckdb:duckdb +1.4% -4.7% +6.4% +13.2% ➖ noise
91 duckdb:vortex-compact +5.2% -4.7% +10.4% +10.0% 🚨 regression
91 duckdb:vortex-file-compressed +7.5% -4.7% +12.8% +10.0% 🚨 regression
92 datafusion:vortex-compact +7.3% +4.0% +3.2% +10.0% ➖ noise
92 datafusion:vortex-file-compressed -3.5% +4.0% -7.2% +10.0% ➖ noise
92 duckdb:duckdb +11.4% +4.0% +7.1% +12.0% ➖ noise
92 duckdb:vortex-compact +2.5% +4.0% -1.4% +13.8% ➖ noise
92 duckdb:vortex-file-compressed +7.3% +4.0% +3.2% +10.0% ➖ noise
93 datafusion:vortex-compact +2.4% +3.6% -1.2% +10.2% ➖ noise
93 datafusion:vortex-file-compressed -2.9% +3.6% -6.3% +10.0% ➖ noise
93 duckdb:duckdb +6.6% +3.6% +2.9% +11.9% ➖ noise
93 duckdb:vortex-compact +10.7% +3.6% +6.8% +14.2% ➖ noise
93 duckdb:vortex-file-compressed +7.1% +3.6% +3.3% +14.0% ➖ noise
94 datafusion:vortex-compact +0.7% -1.7% +2.5% +10.0% ➖ noise
94 datafusion:vortex-file-compressed -7.7% -1.7% -6.0% +13.1% ➖ noise
94 duckdb:duckdb +7.8% -1.7% +9.7% +12.0% ➖ noise
94 duckdb:vortex-compact +0.2% -1.7% +2.0% +10.0% ➖ noise
94 duckdb:vortex-file-compressed +4.4% -1.7% +6.3% +10.0% ➖ noise
95 datafusion:vortex-compact -1.5% -4.8% +3.5% +10.0% ➖ noise
95 datafusion:vortex-file-compressed +0.2% -4.8% +5.2% +10.8% ➖ noise
95 duckdb:duckdb +21.5% -4.8% +27.6% +20.0% 🚨 regression
95 duckdb:vortex-compact +2.8% -4.8% +7.9% +12.5% ➖ noise
95 duckdb:vortex-file-compressed +3.6% -4.8% +8.8% +15.9% ➖ noise
96 datafusion:vortex-compact +1.1% -1.9% +3.0% +10.5% ➖ noise
96 datafusion:vortex-file-compressed +2.0% -1.9% +4.0% +12.3% ➖ noise
96 duckdb:duckdb +5.1% -1.9% +7.1% +16.6% ➖ noise
96 duckdb:vortex-compact +5.4% -1.9% +7.4% +17.3% ➖ noise
96 duckdb:vortex-file-compressed +5.0% -1.9% +7.0% +14.2% ➖ noise
97 datafusion:vortex-compact +3.9% +0.3% +3.7% +10.0% ➖ noise
97 datafusion:vortex-file-compressed -1.3% +0.3% -1.6% +10.0% ➖ noise
97 duckdb:duckdb +10.4% +0.3% +10.1% +15.0% ➖ noise
97 duckdb:vortex-compact +6.5% +0.3% +6.2% +12.5% ➖ noise
97 duckdb:vortex-file-compressed +2.4% +0.3% +2.2% +11.8% ➖ noise
98 datafusion:vortex-compact -0.0% +1.8% -1.8% +10.0% ➖ noise
98 datafusion:vortex-file-compressed +6.6% +1.8% +4.7% +10.0% ➖ noise
98 duckdb:duckdb +2.8% +1.8% +1.0% +11.7% ➖ noise
98 duckdb:vortex-compact +6.0% +1.8% +4.1% +11.1% ➖ noise
98 duckdb:vortex-file-compressed +4.4% +1.8% +2.5% +12.4% ➖ noise
99 datafusion:vortex-compact -3.1% -6.7% +3.8% +12.8% ➖ noise
99 datafusion:vortex-file-compressed -0.0% -6.7% +7.1% +12.9% ➖ noise
99 duckdb:duckdb +2.3% -6.7% +9.6% +29.4% ➖ noise
99 duckdb:vortex-compact -2.3% -6.7% +4.7% +17.4% ➖ noise
99 duckdb:vortex-file-compressed +2.4% -6.7% +9.7% +11.5% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 2, 2026

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.0%
Vortex (geomean): 0.980x ➖
Parquet (geomean): 0.985x ➖
Shifts: Parquet (control) -1.5% · Median polish -1.5%

datafusion / vortex-file-compressed (0.984x ➖, 0↑ 0↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 415394572 433187877 0.96
tpch_q02/datafusion:vortex-file-compressed 120603270 121519697 0.99
tpch_q03/datafusion:vortex-file-compressed 216690218 215540436 1.01
tpch_q04/datafusion:vortex-file-compressed 103458239 108862363 0.95
tpch_q05/datafusion:vortex-file-compressed 405021397 427204595 0.95
tpch_q06/datafusion:vortex-file-compressed 42396665 44089654 0.96
tpch_q07/datafusion:vortex-file-compressed 598721858 604772942 0.99
tpch_q08/datafusion:vortex-file-compressed 397999656 416410231 0.96
tpch_q09/datafusion:vortex-file-compressed 707001893 738306771 0.96
tpch_q10/datafusion:vortex-file-compressed 253121167 257246315 0.98
tpch_q11/datafusion:vortex-file-compressed 87971343 91646723 0.96
tpch_q12/datafusion:vortex-file-compressed 112779797 116101215 0.97
tpch_q13/datafusion:vortex-file-compressed 234904780 237583226 0.99
tpch_q14/datafusion:vortex-file-compressed 62598149 62092174 1.01
tpch_q15/datafusion:vortex-file-compressed 112021666 111909590 1.00
tpch_q16/datafusion:vortex-file-compressed 85192982 79693356 1.07
tpch_q17/datafusion:vortex-file-compressed 692136089 693662761 1.00
tpch_q18/datafusion:vortex-file-compressed 934398433 958988904 0.97
tpch_q19/datafusion:vortex-file-compressed 100170455 100245115 1.00
tpch_q20/datafusion:vortex-file-compressed 189619726 182923976 1.04
tpch_q21/datafusion:vortex-file-compressed 703623371 721383206 0.98
tpch_q22/datafusion:vortex-file-compressed 63446277 64645075 0.98
datafusion / vortex-compact (0.972x ➖, 0↑ 0↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 449782750 468091454 0.96
tpch_q02/datafusion:vortex-compact 128157204 127226379 1.01
tpch_q03/datafusion:vortex-compact 225492046 234752082 0.96
tpch_q04/datafusion:vortex-compact 124919009 128156761 0.97
tpch_q05/datafusion:vortex-compact 420439323 427916296 0.98
tpch_q06/datafusion:vortex-compact 65803969 70455985 0.93
tpch_q07/datafusion:vortex-compact 625122804 636168387 0.98
tpch_q08/datafusion:vortex-compact 408715195 420366358 0.97
tpch_q09/datafusion:vortex-compact 730604414 739593445 0.99
tpch_q10/datafusion:vortex-compact 289807776 298964100 0.97
tpch_q11/datafusion:vortex-compact 95586109 100500785 0.95
tpch_q12/datafusion:vortex-compact 177336345 183117846 0.97
tpch_q13/datafusion:vortex-compact 285343457 293561954 0.97
tpch_q14/datafusion:vortex-compact 77664574 81559932 0.95
tpch_q15/datafusion:vortex-compact 174886499 179697045 0.97
tpch_q16/datafusion:vortex-compact 86407595 87146031 0.99
tpch_q17/datafusion:vortex-compact 692784258 698921998 0.99
tpch_q18/datafusion:vortex-compact 947019917 966308760 0.98
tpch_q19/datafusion:vortex-compact 150506309 150067551 1.00
tpch_q20/datafusion:vortex-compact 208612296 214778703 0.97
tpch_q21/datafusion:vortex-compact 743929174 781238022 0.95
tpch_q22/datafusion:vortex-compact 75525870 79709265 0.95
datafusion / parquet (0.987x ➖, 1↑ 0↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 427138381 464988494 0.92
tpch_q02/datafusion:parquet 194391922 198702694 0.98
tpch_q03/datafusion:parquet 308083756 315972462 0.98
tpch_q04/datafusion:parquet 142134661 140316150 1.01
tpch_q05/datafusion:parquet 468204411 475380592 0.98
tpch_q06/datafusion:parquet 🚀 119366038 132756572 0.90
tpch_q07/datafusion:parquet 668817833 669611615 1.00
tpch_q08/datafusion:parquet 518140816 513515301 1.01
tpch_q09/datafusion:parquet 820557201 832233247 0.99
tpch_q10/datafusion:parquet 525716741 531250673 0.99
tpch_q11/datafusion:parquet 143909141 139543729 1.03
tpch_q12/datafusion:parquet 225499962 211566109 1.07
tpch_q13/datafusion:parquet 350394883 354800651 0.99
tpch_q14/datafusion:parquet 167492071 168676159 0.99
tpch_q15/datafusion:parquet 255990764 270710534 0.95
tpch_q16/datafusion:parquet 142793327 143406956 1.00
tpch_q17/datafusion:parquet 731222848 730885800 1.00
tpch_q18/datafusion:parquet 958128444 966858109 0.99
tpch_q19/datafusion:parquet 294158896 287264487 1.02
tpch_q20/datafusion:parquet 316758410 323362229 0.98
tpch_q21/datafusion:parquet 770962034 800608679 0.96
tpch_q22/datafusion:parquet 222617653 224219302 0.99
datafusion / arrow (0.997x ➖, 0↑ 1↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 634664423 647722623 0.98
tpch_q02/datafusion:arrow 168607756 178910742 0.94
tpch_q03/datafusion:arrow 503946769 511013602 0.99
tpch_q04/datafusion:arrow 382980398 391768811 0.98
tpch_q05/datafusion:arrow 991429378 984563570 1.01
tpch_q06/datafusion:arrow 299461809 299608484 1.00
tpch_q07/datafusion:arrow 1235321490 1242515359 0.99
tpch_q08/datafusion:arrow 1221061079 1255037243 0.97
tpch_q09/datafusion:arrow 1420964434 1428634873 0.99
tpch_q10/datafusion:arrow 649769882 656951560 0.99
tpch_q11/datafusion:arrow 156888658 156734868 1.00
tpch_q12/datafusion:arrow 🚨 824906152 731054969 1.13
tpch_q13/datafusion:arrow 533723485 533356617 1.00
tpch_q14/datafusion:arrow 352297507 344091166 1.02
tpch_q15/datafusion:arrow 746360047 760553874 0.98
tpch_q16/datafusion:arrow 109660505 112915139 0.97
tpch_q17/datafusion:arrow 1396424735 1411687700 0.99
tpch_q18/datafusion:arrow 1929792248 1931142269 1.00
tpch_q19/datafusion:arrow 540727127 545938806 0.99
tpch_q20/datafusion:arrow 542379934 536547467 1.01
tpch_q21/datafusion:arrow 2996359282 2969705858 1.01
tpch_q22/datafusion:arrow 151926161 153032662 0.99
duckdb / vortex-file-compressed (0.985x ➖, 0↑ 0↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 178778500 185422589 0.96
tpch_q02/duckdb:vortex-file-compressed 55857932 56226401 0.99
tpch_q03/duckdb:vortex-file-compressed 134194515 134742067 1.00
tpch_q04/duckdb:vortex-file-compressed 156441525 161766032 0.97
tpch_q05/duckdb:vortex-file-compressed 141200306 140094862 1.01
tpch_q06/duckdb:vortex-file-compressed 51390114 51134976 1.00
tpch_q07/duckdb:vortex-file-compressed 155268189 158542351 0.98
tpch_q08/duckdb:vortex-file-compressed 190391156 186341337 1.02
tpch_q09/duckdb:vortex-file-compressed 342777111 351727192 0.97
tpch_q10/duckdb:vortex-file-compressed 162982659 162538279 1.00
tpch_q11/duckdb:vortex-file-compressed 37901535 38725632 0.98
tpch_q12/duckdb:vortex-file-compressed 95225015 96895285 0.98
tpch_q13/duckdb:vortex-file-compressed 257019715 263436630 0.98
tpch_q14/duckdb:vortex-file-compressed 71614193 75019858 0.95
tpch_q15/duckdb:vortex-file-compressed 101848067 102246796 1.00
tpch_q16/duckdb:vortex-file-compressed 81898787 84111983 0.97
tpch_q17/duckdb:vortex-file-compressed 108978099 108276292 1.01
tpch_q18/duckdb:vortex-file-compressed 283435154 287039219 0.99
tpch_q19/duckdb:vortex-file-compressed 93196342 94724142 0.98
tpch_q20/duckdb:vortex-file-compressed 172966446 176711809 0.98
tpch_q21/duckdb:vortex-file-compressed 578230835 587016519 0.99
tpch_q22/duckdb:vortex-file-compressed 79110395 81908049 0.97
duckdb / vortex-compact (0.980x ➖, 0↑ 0↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 234808437 243342838 0.96
tpch_q02/duckdb:vortex-compact 63009251 61894943 1.02
tpch_q03/duckdb:vortex-compact 147451606 151049843 0.98
tpch_q04/duckdb:vortex-compact 185896466 192729887 0.96
tpch_q05/duckdb:vortex-compact 155174791 158497517 0.98
tpch_q06/duckdb:vortex-compact 88443162 90381133 0.98
tpch_q07/duckdb:vortex-compact 214074080 224316958 0.95
tpch_q08/duckdb:vortex-compact 199486697 208717174 0.96
tpch_q09/duckdb:vortex-compact 378663993 386262078 0.98
tpch_q10/duckdb:vortex-compact 197578835 200765669 0.98
tpch_q11/duckdb:vortex-compact 44116930 44328147 1.00
tpch_q12/duckdb:vortex-compact 212976177 217194851 0.98
tpch_q13/duckdb:vortex-compact 309864664 316793823 0.98
tpch_q14/duckdb:vortex-compact 108563851 113709256 0.95
tpch_q15/duckdb:vortex-compact 128589089 128339689 1.00
tpch_q16/duckdb:vortex-compact 88375423 90558451 0.98
tpch_q17/duckdb:vortex-compact 124068728 123828063 1.00
tpch_q18/duckdb:vortex-compact 302884466 307440080 0.99
tpch_q19/duckdb:vortex-compact 119159594 119783053 0.99
tpch_q20/duckdb:vortex-compact 217302170 222179510 0.98
tpch_q21/duckdb:vortex-compact 655271163 667230908 0.98
tpch_q22/duckdb:vortex-compact 92006279 94702846 0.97
duckdb / parquet (0.983x ➖, 1↑ 0↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 259203059 274160833 0.95
tpch_q02/duckdb:parquet 105665520 107832906 0.98
tpch_q03/duckdb:parquet 214501528 220102207 0.97
tpch_q04/duckdb:parquet 139838643 137492644 1.02
tpch_q05/duckdb:parquet 226366487 224534955 1.01
tpch_q06/duckdb:parquet 69913030 68148687 1.03
tpch_q07/duckdb:parquet 183522607 188082976 0.98
tpch_q08/duckdb:parquet 259902724 263733871 0.99
tpch_q09/duckdb:parquet 474951336 478525614 0.99
tpch_q10/duckdb:parquet 616400754 623582843 0.99
tpch_q11/duckdb:parquet 🚀 39967073 46182904 0.87
tpch_q12/duckdb:parquet 126668698 126406306 1.00
tpch_q13/duckdb:parquet 451246816 469000870 0.96
tpch_q14/duckdb:parquet 178273726 176057688 1.01
tpch_q15/duckdb:parquet 99665802 100575796 0.99
tpch_q16/duckdb:parquet 160447212 167686693 0.96
tpch_q17/duckdb:parquet 179061954 182055811 0.98
tpch_q18/duckdb:parquet 360721057 358938007 1.00
tpch_q19/duckdb:parquet 287184974 295174396 0.97
tpch_q20/duckdb:parquet 232809575 233290698 1.00
tpch_q21/duckdb:parquet 589449425 595192924 0.99
tpch_q22/duckdb:parquet 292760994 292011419 1.00
duckdb / duckdb (0.992x ➖, 0↑ 0↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 118118214 118738663 0.99
tpch_q02/duckdb:duckdb 45574877 49369150 0.92
tpch_q03/duckdb:duckdb 97968592 99036561 0.99
tpch_q04/duckdb:duckdb 135096377 136992277 0.99
tpch_q05/duckdb:duckdb 110422145 114921154 0.96
tpch_q06/duckdb:duckdb 39572924 37409987 1.06
tpch_q07/duckdb:duckdb 86789168 89123759 0.97
tpch_q08/duckdb:duckdb 114128300 115411598 0.99
tpch_q09/duckdb:duckdb 285196545 285202840 1.00
tpch_q10/duckdb:duckdb 203317967 207566257 0.98
tpch_q11/duckdb:duckdb 17384041 15835801 1.10
tpch_q12/duckdb:duckdb 86889076 86638378 1.00
tpch_q13/duckdb:duckdb 256479600 270251267 0.95
tpch_q14/duckdb:duckdb 72252525 72366519 1.00
tpch_q15/duckdb:duckdb 77719164 79621396 0.98
tpch_q16/duckdb:duckdb 74473536 75749424 0.98
tpch_q17/duckdb:duckdb 84862358 85475136 0.99
tpch_q18/duckdb:duckdb 217771400 220846897 0.99
tpch_q19/duckdb:duckdb 118761217 118684947 1.00
tpch_q20/duckdb:duckdb 113682648 115036785 0.99
tpch_q21/duckdb:duckdb 319640642 316938098 1.01
tpch_q22/duckdb:duckdb 65538287 65556051 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -2.0% -6.8% +5.1% +10.6% ➖ noise
1 datafusion:vortex-compact -3.9% -6.8% +3.1% +12.0% ➖ noise
1 datafusion:vortex-file-compressed -4.1% -6.8% +2.9% +11.9% ➖ noise
1 duckdb:duckdb -0.5% -6.8% +6.7% +10.0% ➖ noise
1 duckdb:vortex-compact -3.5% -6.8% +3.5% +10.8% ➖ noise
1 duckdb:vortex-file-compressed -3.6% -6.8% +3.5% +11.1% ➖ noise
2 datafusion:arrow -5.8% -2.1% -3.7% +10.0% ➖ noise
2 datafusion:vortex-compact +0.7% -2.1% +2.9% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -0.8% -2.1% +1.4% +10.0% ➖ noise
2 duckdb:duckdb -7.7% -2.1% -5.7% +10.7% ➖ noise
2 duckdb:vortex-compact +1.8% -2.1% +4.0% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -0.7% -2.1% +1.5% +10.7% ➖ noise
3 datafusion:arrow -1.4% -2.5% +1.2% +10.0% ➖ noise
3 datafusion:vortex-compact -3.9% -2.5% -1.5% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +0.5% -2.5% +3.1% +10.0% ➖ noise
3 duckdb:duckdb -1.1% -2.5% +1.5% +10.0% ➖ noise
3 duckdb:vortex-compact -2.4% -2.5% +0.1% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -0.4% -2.5% +2.2% +10.0% ➖ noise
4 datafusion:arrow -2.2% +1.5% -3.7% +10.0% ➖ noise
4 datafusion:vortex-compact -2.5% +1.5% -4.0% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -5.0% +1.5% -6.4% +10.0% ➖ noise
4 duckdb:duckdb -1.4% +1.5% -2.8% +10.0% ➖ noise
4 duckdb:vortex-compact -3.5% +1.5% -5.0% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -3.3% +1.5% -4.7% +10.0% ➖ noise
5 datafusion:arrow +0.7% -0.4% +1.1% +10.0% ➖ noise
5 datafusion:vortex-compact -1.7% -0.4% -1.4% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -5.2% -0.4% -4.9% +10.0% ➖ noise
5 duckdb:duckdb -3.9% -0.4% -3.6% +10.0% ➖ noise
5 duckdb:vortex-compact -2.1% -0.4% -1.7% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +0.8% -0.4% +1.1% +10.0% ➖ noise
6 datafusion:arrow -0.0% -4.0% +4.1% +10.0% ➖ noise
6 datafusion:vortex-compact -6.6% -4.0% -2.8% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -3.8% -4.0% +0.1% +10.0% ➖ noise
6 duckdb:duckdb +5.8% -4.0% +10.1% +14.6% ➖ noise
6 duckdb:vortex-compact -2.1% -4.0% +1.9% +10.2% ➖ noise
6 duckdb:vortex-file-compressed +0.5% -4.0% +4.6% +10.0% ➖ noise
7 datafusion:arrow -0.6% -1.3% +0.7% +10.0% ➖ noise
7 datafusion:vortex-compact -1.7% -1.3% -0.5% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -1.0% -1.3% +0.3% +10.0% ➖ noise
7 duckdb:duckdb -2.6% -1.3% -1.4% +12.7% ➖ noise
7 duckdb:vortex-compact -4.6% -1.3% -3.3% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -2.1% -1.3% -0.8% +10.0% ➖ noise
8 datafusion:arrow -2.7% -0.3% -2.4% +10.0% ➖ noise
8 datafusion:vortex-compact -2.8% -0.3% -2.5% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -4.4% -0.3% -4.2% +10.0% ➖ noise
8 duckdb:duckdb -1.1% -0.3% -0.8% +10.0% ➖ noise
8 duckdb:vortex-compact -4.4% -0.3% -4.2% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +2.2% -0.3% +2.5% +10.0% ➖ noise
9 datafusion:arrow -0.5% -1.1% +0.5% +10.0% ➖ noise
9 datafusion:vortex-compact -1.2% -1.1% -0.1% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -4.2% -1.1% -3.2% +10.0% ➖ noise
9 duckdb:duckdb -0.0% -1.1% +1.1% +10.0% ➖ noise
9 duckdb:vortex-compact -2.0% -1.1% -0.9% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -2.5% -1.1% -1.5% +10.0% ➖ noise
10 datafusion:arrow -1.1% -1.1% +0.0% +10.0% ➖ noise
10 datafusion:vortex-compact -3.1% -1.1% -2.0% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -1.6% -1.1% -0.5% +10.0% ➖ noise
10 duckdb:duckdb -2.0% -1.1% -1.0% +10.0% ➖ noise
10 duckdb:vortex-compact -1.6% -1.1% -0.5% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +0.3% -1.1% +1.4% +10.0% ➖ noise
11 datafusion:arrow +0.1% -5.5% +6.0% +10.8% ➖ noise
11 datafusion:vortex-compact -4.9% -5.5% +0.7% +14.9% ➖ noise
11 datafusion:vortex-file-compressed -4.0% -5.5% +1.6% +12.0% ➖ noise
11 duckdb:duckdb +9.8% -5.5% +16.2% +17.1% ➖ noise
11 duckdb:vortex-compact -0.5% -5.5% +5.3% +15.7% ➖ noise
11 duckdb:vortex-file-compressed -2.1% -5.5% +3.6% +14.4% ➖ noise
12 datafusion:arrow +12.8% +3.3% +9.2% +43.3% ➖ noise
12 datafusion:vortex-compact -3.2% +3.3% -6.3% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -2.9% +3.3% -6.0% +10.0% ➖ noise
12 duckdb:duckdb +0.3% +3.3% -3.0% +10.0% ➖ noise
12 duckdb:vortex-compact -1.9% +3.3% -5.1% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -1.7% +3.3% -4.9% +10.0% ➖ noise
13 datafusion:arrow +0.1% -2.5% +2.7% +10.0% ➖ noise
13 datafusion:vortex-compact -2.8% -2.5% -0.3% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -1.1% -2.5% +1.4% +10.0% ➖ noise
13 duckdb:duckdb -5.1% -2.5% -2.6% +10.0% ➖ noise
13 duckdb:vortex-compact -2.2% -2.5% +0.3% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -2.4% -2.5% +0.1% +10.0% ➖ noise
14 datafusion:arrow +2.4% +0.3% +2.1% +10.0% ➖ noise
14 datafusion:vortex-compact -4.8% +0.3% -5.0% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +0.8% +0.3% +0.5% +13.7% ➖ noise
14 duckdb:duckdb -0.2% +0.3% -0.4% +10.0% ➖ noise
14 duckdb:vortex-compact -4.5% +0.3% -4.8% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -4.5% +0.3% -4.8% +10.0% ➖ noise
15 datafusion:arrow -1.9% -3.2% +1.4% +10.0% ➖ noise
15 datafusion:vortex-compact -2.7% -3.2% +0.5% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +0.1% -3.2% +3.4% +10.0% ➖ noise
15 duckdb:duckdb -2.4% -3.2% +0.8% +10.0% ➖ noise
15 duckdb:vortex-compact +0.2% -3.2% +3.5% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -0.4% -3.2% +2.9% +10.0% ➖ noise
16 datafusion:arrow -2.9% -2.4% -0.5% +11.7% ➖ noise
16 datafusion:vortex-compact -0.8% -2.4% +1.6% +10.6% ➖ noise
16 datafusion:vortex-file-compressed +6.9% -2.4% +9.5% +12.9% ➖ noise
16 duckdb:duckdb -1.7% -2.4% +0.7% +10.1% ➖ noise
16 duckdb:vortex-compact -2.4% -2.4% -0.0% +10.8% ➖ noise
16 duckdb:vortex-file-compressed -2.6% -2.4% -0.2% +10.0% ➖ noise
17 datafusion:arrow -1.1% -0.8% -0.3% +10.0% ➖ noise
17 datafusion:vortex-compact -0.9% -0.8% -0.1% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -0.2% -0.8% +0.6% +10.0% ➖ noise
17 duckdb:duckdb -0.7% -0.8% +0.1% +10.0% ➖ noise
17 duckdb:vortex-compact +0.2% -0.8% +1.0% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +0.6% -0.8% +1.5% +10.0% ➖ noise
18 datafusion:arrow -0.1% -0.2% +0.1% +10.0% ➖ noise
18 datafusion:vortex-compact -2.0% -0.2% -1.8% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -2.6% -0.2% -2.4% +10.0% ➖ noise
18 duckdb:duckdb -1.4% -0.2% -1.2% +10.0% ➖ noise
18 duckdb:vortex-compact -1.5% -0.2% -1.3% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -1.3% -0.2% -1.1% +10.0% ➖ noise
19 datafusion:arrow -1.0% -0.2% -0.8% +10.0% ➖ noise
19 datafusion:vortex-compact +0.3% -0.2% +0.5% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -0.1% -0.2% +0.1% +13.1% ➖ noise
19 duckdb:duckdb +0.1% -0.2% +0.3% +10.0% ➖ noise
19 duckdb:vortex-compact -0.5% -0.2% -0.3% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -1.6% -0.2% -1.4% +10.0% ➖ noise
20 datafusion:arrow +1.1% -1.1% +2.2% +10.0% ➖ noise
20 datafusion:vortex-compact -2.9% -1.1% -1.8% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +3.7% -1.1% +4.8% +10.0% ➖ noise
20 duckdb:duckdb -1.2% -1.1% -0.0% +10.0% ➖ noise
20 duckdb:vortex-compact -2.2% -1.1% -1.1% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -2.1% -1.1% -1.0% +10.0% ➖ noise
21 datafusion:arrow +0.9% -2.3% +3.3% +10.0% ➖ noise
21 datafusion:vortex-compact -4.8% -2.3% -2.5% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -2.5% -2.3% -0.1% +10.0% ➖ noise
21 duckdb:duckdb +0.9% -2.3% +3.3% +10.0% ➖ noise
21 duckdb:vortex-compact -1.8% -2.3% +0.6% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -1.5% -2.3% +0.9% +10.0% ➖ noise
22 datafusion:arrow -0.7% -0.2% -0.5% +10.0% ➖ noise
22 datafusion:vortex-compact -5.2% -0.2% -5.0% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -1.9% -0.2% -1.6% +10.0% ➖ noise
22 duckdb:duckdb -0.0% -0.2% +0.2% +13.9% ➖ noise
22 duckdb:vortex-compact -2.8% -0.2% -2.6% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -3.4% -0.2% -3.2% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 2, 2026

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +15.0%
Vortex (geomean): 1.018x ➖
Parquet (geomean): 0.885x ➖
Shifts: Parquet (control) -11.5% · Median polish +3.3%

datafusion / vortex-file-compressed (0.984x ➖, 3↑ 3↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 300545945 255292493 1.18
tpch_q02/datafusion:vortex-file-compressed 🚨 816634104 561087098 1.46
tpch_q03/datafusion:vortex-file-compressed 🚨 485366314 366598145 1.32
tpch_q04/datafusion:vortex-file-compressed 257104119 221518296 1.16
tpch_q05/datafusion:vortex-file-compressed 475188493 538370582 0.88
tpch_q06/datafusion:vortex-file-compressed 410248352 330858893 1.24
tpch_q07/datafusion:vortex-file-compressed 504303694 594325888 0.85
tpch_q08/datafusion:vortex-file-compressed 710612761 882631508 0.81
tpch_q09/datafusion:vortex-file-compressed 🚀 468192439 719919170 0.65
tpch_q10/datafusion:vortex-file-compressed 🚀 472219921 1026605785 0.46
tpch_q11/datafusion:vortex-file-compressed 557243308 557598434 1.00
tpch_q12/datafusion:vortex-file-compressed 555016711 532501102 1.04
tpch_q13/datafusion:vortex-file-compressed 364949170 282955019 1.29
tpch_q14/datafusion:vortex-file-compressed 🚨 344983778 234658775 1.47
tpch_q15/datafusion:vortex-file-compressed 445002679 409302402 1.09
tpch_q16/datafusion:vortex-file-compressed 🚀 283874239 406425410 0.70
tpch_q17/datafusion:vortex-file-compressed 403486475 507591875 0.79
tpch_q18/datafusion:vortex-file-compressed 393563309 402340221 0.98
tpch_q19/datafusion:vortex-file-compressed 400243152 481428179 0.83
tpch_q20/datafusion:vortex-file-compressed 393985591 358405290 1.10
tpch_q21/datafusion:vortex-file-compressed 522571188 496320047 1.05
tpch_q22/datafusion:vortex-file-compressed 158402810 148258315 1.07
datafusion / vortex-compact (1.030x ➖, 1↑ 0↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 381711979 314513665 1.21
tpch_q02/datafusion:vortex-compact 475352024 514295338 0.92
tpch_q03/datafusion:vortex-compact 420731412 531856646 0.79
tpch_q04/datafusion:vortex-compact 327205607 311799326 1.05
tpch_q05/datafusion:vortex-compact 582377848 494659658 1.18
tpch_q06/datafusion:vortex-compact 430242909 519668497 0.83
tpch_q07/datafusion:vortex-compact 487506591 436803871 1.12
tpch_q08/datafusion:vortex-compact 644341781 549042611 1.17
tpch_q09/datafusion:vortex-compact 532596219 458034304 1.16
tpch_q10/datafusion:vortex-compact 593063116 509515191 1.16
tpch_q11/datafusion:vortex-compact 271286503 296577055 0.91
tpch_q12/datafusion:vortex-compact 534960997 442714671 1.21
tpch_q13/datafusion:vortex-compact 238044467 215817810 1.10
tpch_q14/datafusion:vortex-compact 299472258 277805564 1.08
tpch_q15/datafusion:vortex-compact 550281101 476495820 1.15
tpch_q16/datafusion:vortex-compact 191431439 198040233 0.97
tpch_q17/datafusion:vortex-compact 432211067 343906431 1.26
tpch_q18/datafusion:vortex-compact 315799569 304635607 1.04
tpch_q19/datafusion:vortex-compact 502455836 455994597 1.10
tpch_q20/datafusion:vortex-compact 479515030 448397215 1.07
tpch_q21/datafusion:vortex-compact 648912589 765350355 0.85
tpch_q22/datafusion:vortex-compact 🚀 143750185 232882003 0.62
datafusion / parquet (0.830x ➖, 4↑ 0↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 188454180 199373381 0.95
tpch_q02/datafusion:parquet 406848954 421641485 0.96
tpch_q03/datafusion:parquet 324463311 303532991 1.07
tpch_q04/datafusion:parquet 143085440 133486793 1.07
tpch_q05/datafusion:parquet 492664730 574688560 0.86
tpch_q06/datafusion:parquet 142713320 178274490 0.80
tpch_q07/datafusion:parquet 490699871 639784536 0.77
tpch_q08/datafusion:parquet 612262648 697399214 0.88
tpch_q09/datafusion:parquet 504370359 472636020 1.07
tpch_q10/datafusion:parquet 528671063 584868552 0.90
tpch_q11/datafusion:parquet 363983656 338745455 1.07
tpch_q12/datafusion:parquet 347981336 461783929 0.75
tpch_q13/datafusion:parquet 440301147 473620511 0.93
tpch_q14/datafusion:parquet 🚀 193094086 344762833 0.56
tpch_q15/datafusion:parquet 🚀 344021185 649315040 0.53
tpch_q16/datafusion:parquet 229380597 297871840 0.77
tpch_q17/datafusion:parquet 🚀 352860071 585449886 0.60
tpch_q18/datafusion:parquet 🚀 418027621 853546163 0.49
tpch_q19/datafusion:parquet 321641726 349987887 0.92
tpch_q20/datafusion:parquet 343567229 368461602 0.93
tpch_q21/datafusion:parquet 514893240 631038977 0.82
tpch_q22/datafusion:parquet 131820900 130253388 1.01
duckdb / vortex-file-compressed (1.019x ➖, 0↑ 0↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 271049842 262587554 1.03
tpch_q02/duckdb:vortex-file-compressed 941719926 835369344 1.13
tpch_q03/duckdb:vortex-file-compressed 645105218 645413395 1.00
tpch_q04/duckdb:vortex-file-compressed 341426993 403701039 0.85
tpch_q05/duckdb:vortex-file-compressed 925317110 1057753421 0.87
tpch_q06/duckdb:vortex-file-compressed 421199581 397546964 1.06
tpch_q07/duckdb:vortex-file-compressed 745808922 720916979 1.03
tpch_q08/duckdb:vortex-file-compressed 962473823 924586149 1.04
tpch_q09/duckdb:vortex-file-compressed 908445996 832954689 1.09
tpch_q10/duckdb:vortex-file-compressed 701396333 677791839 1.03
tpch_q11/duckdb:vortex-file-compressed 515698495 454502555 1.13
tpch_q12/duckdb:vortex-file-compressed 464999987 571577738 0.81
tpch_q13/duckdb:vortex-file-compressed 522850261 471640294 1.11
tpch_q14/duckdb:vortex-file-compressed 477354304 512579613 0.93
tpch_q15/duckdb:vortex-file-compressed 260179233 249294245 1.04
tpch_q16/duckdb:vortex-file-compressed 330011616 320419682 1.03
tpch_q17/duckdb:vortex-file-compressed 717299445 643699326 1.11
tpch_q18/duckdb:vortex-file-compressed 547738372 560644827 0.98
tpch_q19/duckdb:vortex-file-compressed 423622748 383860060 1.10
tpch_q20/duckdb:vortex-file-compressed 759255065 735316030 1.03
tpch_q21/duckdb:vortex-file-compressed 1125110682 1007680003 1.12
tpch_q22/duckdb:vortex-file-compressed 352418281 369544189 0.95
duckdb / vortex-compact (1.041x ➖, 0↑ 1↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 246085524 280684060 0.88
tpch_q02/duckdb:vortex-compact 828622188 1017826830 0.81
tpch_q03/duckdb:vortex-compact 637783751 583094424 1.09
tpch_q04/duckdb:vortex-compact 352738500 367189489 0.96
tpch_q05/duckdb:vortex-compact 843898046 807708603 1.04
tpch_q06/duckdb:vortex-compact 🚨 535570781 394500517 1.36
tpch_q07/duckdb:vortex-compact 718539615 660257074 1.09
tpch_q08/duckdb:vortex-compact 915661840 877412099 1.04
tpch_q09/duckdb:vortex-compact 950541279 804093365 1.18
tpch_q10/duckdb:vortex-compact 625529808 609221986 1.03
tpch_q11/duckdb:vortex-compact 489459192 467450417 1.05
tpch_q12/duckdb:vortex-compact 437820012 464823029 0.94
tpch_q13/duckdb:vortex-compact 476448829 469115395 1.02
tpch_q14/duckdb:vortex-compact 443472773 370267881 1.20
tpch_q15/duckdb:vortex-compact 258351006 208324067 1.24
tpch_q16/duckdb:vortex-compact 359714456 291480178 1.23
tpch_q17/duckdb:vortex-compact 609414705 665111930 0.92
tpch_q18/duckdb:vortex-compact 485122745 454135799 1.07
tpch_q19/duckdb:vortex-compact 401861619 441501314 0.91
tpch_q20/duckdb:vortex-compact 829958978 813329240 1.02
tpch_q21/duckdb:vortex-compact 1130020042 1060222892 1.07
tpch_q22/duckdb:vortex-compact 333561547 362249351 0.92
duckdb / parquet (0.944x ➖, 1↑ 0↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 495069596 558138819 0.89
tpch_q02/duckdb:parquet 1359804763 1312081788 1.04
tpch_q03/duckdb:parquet 1216147533 1018851085 1.19
tpch_q04/duckdb:parquet 617144462 781848415 0.79
tpch_q05/duckdb:parquet 1557989460 1813021846 0.86
tpch_q06/duckdb:parquet 413262981 475180761 0.87
tpch_q07/duckdb:parquet 1318011360 1241094623 1.06
tpch_q08/duckdb:parquet 1661213247 1689199881 0.98
tpch_q09/duckdb:parquet 1337251377 1446735224 0.92
tpch_q10/duckdb:parquet 1424825436 1229180043 1.16
tpch_q11/duckdb:parquet 815763236 880330554 0.93
tpch_q12/duckdb:parquet 589495131 647049231 0.91
tpch_q13/duckdb:parquet 864210911 957689854 0.90
tpch_q14/duckdb:parquet 693923107 660109800 1.05
tpch_q15/duckdb:parquet 498355198 487951564 1.02
tpch_q16/duckdb:parquet 511980722 563702238 0.91
tpch_q17/duckdb:parquet 🚀 743442951 1091610503 0.68
tpch_q18/duckdb:parquet 952879555 841027242 1.13
tpch_q19/duckdb:parquet 760198390 815762706 0.93
tpch_q20/duckdb:parquet 1005006332 1225715893 0.82
tpch_q21/duckdb:parquet 1138410146 1315219096 0.87
tpch_q22/duckdb:parquet 525799432 509428855 1.03
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +21.4% -8.4% +32.5% +194.5% ➖ noise
1 datafusion:vortex-file-compressed +17.7% -8.4% +28.6% +158.0% ➖ noise
1 duckdb:vortex-compact -12.3% -8.4% -4.3% +85.5% ➖ noise
1 duckdb:vortex-file-compressed +3.2% -8.4% +12.7% +68.1% ➖ noise
2 datafusion:vortex-compact -7.6% +0.0% -7.6% +70.8% ➖ noise
2 datafusion:vortex-file-compressed +45.5% +0.0% +45.5% +43.5% 🚨 regression
2 duckdb:vortex-compact -18.6% +0.0% -18.6% +39.8% ➖ noise
2 duckdb:vortex-file-compressed +12.7% +0.0% +12.7% +39.8% ➖ noise
3 datafusion:vortex-compact -20.9% +13.0% -30.0% +74.1% ➖ noise
3 datafusion:vortex-file-compressed +32.4% +13.0% +17.2% +134.5% ➖ noise
3 duckdb:vortex-compact +9.4% +13.0% -3.2% +47.5% ➖ noise
3 duckdb:vortex-file-compressed -0.0% +13.0% -11.5% +52.5% ➖ noise
4 datafusion:vortex-compact +4.9% -8.0% +14.1% +47.7% ➖ noise
4 datafusion:vortex-file-compressed +16.1% -8.0% +26.2% +47.6% ➖ noise
4 duckdb:vortex-compact -3.9% -8.0% +4.4% +39.8% ➖ noise
4 duckdb:vortex-file-compressed -15.4% -8.0% -8.1% +39.8% ➖ noise
5 datafusion:vortex-compact +17.7% -14.2% +37.2% +39.8% ➖ noise
5 datafusion:vortex-file-compressed -11.7% -14.2% +2.8% +39.8% ➖ noise
5 duckdb:vortex-compact +4.5% -14.2% +21.7% +39.8% ➖ noise
5 duckdb:vortex-file-compressed -12.5% -14.2% +1.9% +39.8% ➖ noise
6 datafusion:vortex-compact -17.2% -16.6% -0.8% +48.9% ➖ noise
6 datafusion:vortex-file-compressed +24.0% -16.6% +48.6% +53.3% ➖ noise
6 duckdb:vortex-compact +35.8% -16.6% +62.7% +45.2% 🚨 regression
6 duckdb:vortex-file-compressed +5.9% -16.6% +27.0% +55.4% ➖ noise
7 datafusion:vortex-compact +11.6% -9.7% +23.7% +39.8% ➖ noise
7 datafusion:vortex-file-compressed -15.1% -9.7% -6.0% +41.6% ➖ noise
7 duckdb:vortex-compact +8.8% -9.7% +20.6% +39.8% ➖ noise
7 duckdb:vortex-file-compressed +3.5% -9.7% +14.6% +39.8% ➖ noise
8 datafusion:vortex-compact +17.4% -7.1% +26.3% +71.3% ➖ noise
8 datafusion:vortex-file-compressed -19.5% -7.1% -13.4% +51.8% ➖ noise
8 duckdb:vortex-compact +4.4% -7.1% +12.3% +39.8% ➖ noise
8 duckdb:vortex-file-compressed +4.1% -7.1% +12.0% +39.8% ➖ noise
9 datafusion:vortex-compact +16.3% -0.7% +17.1% +51.9% ➖ noise
9 datafusion:vortex-file-compressed -35.0% -0.7% -34.5% +66.7% ➖ noise
9 duckdb:vortex-compact +18.2% -0.7% +19.0% +39.8% ➖ noise
9 duckdb:vortex-file-compressed +9.1% -0.7% +9.8% +39.8% ➖ noise
10 datafusion:vortex-compact +16.4% +2.4% +13.7% +39.8% ➖ noise
10 datafusion:vortex-file-compressed -54.0% +2.4% -55.1% +61.4% ✅ faster
10 duckdb:vortex-compact +2.7% +2.4% +0.3% +40.7% ➖ noise
10 duckdb:vortex-file-compressed +3.5% +2.4% +1.1% +39.8% ➖ noise
11 datafusion:vortex-compact -8.5% -0.2% -8.3% +39.8% ➖ noise
11 datafusion:vortex-file-compressed -0.1% -0.2% +0.2% +70.9% ➖ noise
11 duckdb:vortex-compact +4.7% -0.2% +4.9% +39.8% ➖ noise
11 duckdb:vortex-file-compressed +13.5% -0.2% +13.7% +41.0% ➖ noise
12 datafusion:vortex-compact +20.8% -17.1% +45.8% +45.2% 🚨 regression
12 datafusion:vortex-file-compressed +4.2% -17.1% +25.8% +61.6% ➖ noise
12 duckdb:vortex-compact -5.8% -17.1% +13.7% +57.9% ➖ noise
12 duckdb:vortex-file-compressed -18.6% -17.1% -1.8% +44.1% ➖ noise
13 datafusion:vortex-compact +10.3% -8.4% +20.4% +45.8% ➖ noise
13 datafusion:vortex-file-compressed +29.0% -8.4% +40.8% +141.6% ➖ noise
13 duckdb:vortex-compact +1.6% -8.4% +10.9% +40.6% ➖ noise
13 duckdb:vortex-file-compressed +10.9% -8.4% +21.0% +42.2% ➖ noise
14 datafusion:vortex-compact +7.8% -23.3% +40.5% +49.8% ➖ noise
14 datafusion:vortex-file-compressed +47.0% -23.3% +91.6% +75.3% 🚨 regression
14 duckdb:vortex-compact +19.8% -23.3% +56.1% +44.4% 🚨 regression
14 duckdb:vortex-file-compressed -6.9% -23.3% +21.4% +39.8% ➖ noise
15 datafusion:vortex-compact +15.5% -26.4% +57.0% +46.9% 🚨 regression
15 datafusion:vortex-file-compressed +8.7% -26.4% +47.8% +44.8% 🚨 regression
15 duckdb:vortex-compact +24.0% -26.4% +68.6% +39.8% 🚨 regression
15 duckdb:vortex-file-compressed +4.4% -26.4% +41.9% +39.8% 🚨 regression
16 datafusion:vortex-compact -3.3% -16.4% +15.6% +39.8% ➖ noise
16 datafusion:vortex-file-compressed -30.2% -16.4% -16.5% +57.8% ➖ noise
16 duckdb:vortex-compact +23.4% -16.4% +47.6% +46.1% 🚨 regression
16 duckdb:vortex-file-compressed +3.0% -16.4% +23.2% +39.8% ➖ noise
17 datafusion:vortex-compact +25.7% -35.9% +96.2% +39.8% 🚨 regression
17 datafusion:vortex-file-compressed -20.5% -35.9% +24.1% +45.5% ➖ noise
17 duckdb:vortex-compact -8.4% -35.9% +43.0% +39.8% 🚨 regression
17 duckdb:vortex-file-compressed +11.4% -35.9% +73.9% +39.8% 🚨 regression
18 datafusion:vortex-compact +3.7% -25.5% +39.2% +39.8% ➖ noise
18 datafusion:vortex-file-compressed -2.2% -25.5% +31.3% +41.3% ➖ noise
18 duckdb:vortex-compact +6.8% -25.5% +43.4% +49.8% ➖ noise
18 duckdb:vortex-file-compressed -2.3% -25.5% +31.2% +74.6% ➖ noise
19 datafusion:vortex-compact +10.2% -7.5% +19.1% +44.4% ➖ noise
19 datafusion:vortex-file-compressed -16.9% -7.5% -10.2% +40.0% ➖ noise
19 duckdb:vortex-compact -9.0% -7.5% -1.6% +39.8% ➖ noise
19 duckdb:vortex-file-compressed +10.4% -7.5% +19.3% +39.8% ➖ noise
20 datafusion:vortex-compact +6.9% -12.6% +22.3% +39.8% ➖ noise
20 datafusion:vortex-file-compressed +9.9% -12.6% +25.7% +39.8% ➖ noise
20 duckdb:vortex-compact +2.0% -12.6% +16.7% +39.8% ➖ noise
20 duckdb:vortex-file-compressed +3.3% -12.6% +18.1% +39.8% ➖ noise
21 datafusion:vortex-compact -15.2% -16.0% +0.9% +39.8% ➖ noise
21 datafusion:vortex-file-compressed +5.3% -16.0% +25.3% +39.8% ➖ noise
21 duckdb:vortex-compact +6.6% -16.0% +26.8% +39.8% ➖ noise
21 duckdb:vortex-file-compressed +11.7% -16.0% +32.9% +46.1% ➖ noise
22 datafusion:vortex-compact -38.3% +2.2% -39.6% +86.0% ➖ noise
22 datafusion:vortex-file-compressed +6.8% +2.2% +4.5% +39.8% ➖ noise
22 duckdb:vortex-compact -7.9% +2.2% -9.9% +39.8% ➖ noise
22 duckdb:vortex-file-compressed -4.6% +2.2% -6.7% +39.8% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 2, 2026

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -0.4%
Vortex (geomean): 0.975x ➖
Parquet (geomean): 0.979x ➖
Shifts: Parquet (control) -2.1% · Median polish -2.7%

datafusion / vortex-file-compressed (0.944x ➖, 1↑ 0↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚀 37343432 59018339 0.63
fineweb_q01/datafusion:vortex-file-compressed 653866120 566674583 1.15
fineweb_q02/datafusion:vortex-file-compressed 558944969 612111787 0.91
fineweb_q03/datafusion:vortex-file-compressed 1524396739 1369739575 1.11
fineweb_q04/datafusion:vortex-file-compressed 1392345098 1403864911 0.99
fineweb_q05/datafusion:vortex-file-compressed 1352171372 1362335015 0.99
fineweb_q06/datafusion:vortex-file-compressed 1532515632 1604927533 0.95
fineweb_q07/datafusion:vortex-file-compressed 1409125125 1441314416 0.98
fineweb_q08/datafusion:vortex-file-compressed 551515361 632422188 0.87
datafusion / vortex-compact (1.066x ➖, 0↑ 1↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚨 43384332 32274550 1.34
fineweb_q01/datafusion:vortex-compact 687984323 563367133 1.22
fineweb_q02/datafusion:vortex-compact 784672481 645290948 1.22
fineweb_q03/datafusion:vortex-compact 1832020143 1896399758 0.97
fineweb_q04/datafusion:vortex-compact 2199350624 2237894103 0.98
fineweb_q05/datafusion:vortex-compact 1705289781 1761681732 0.97
fineweb_q06/datafusion:vortex-compact 1396634391 1405095577 0.99
fineweb_q07/datafusion:vortex-compact 1363278594 1383696011 0.99
fineweb_q08/datafusion:vortex-compact 386562686 389353426 0.99
datafusion / parquet (0.969x ➖, 0↑ 1↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚨 1613616534 1122018314 1.44
fineweb_q01/datafusion:parquet 1683006598 1845161854 0.91
fineweb_q02/datafusion:parquet 1962344489 1849665341 1.06
fineweb_q03/datafusion:parquet 2323270944 2322972422 1.00
fineweb_q04/datafusion:parquet 1774246849 2101766153 0.84
fineweb_q05/datafusion:parquet 1923360414 2220336799 0.87
fineweb_q06/datafusion:parquet 1992235800 2408214922 0.83
fineweb_q07/datafusion:parquet 2076474490 1870309126 1.11
fineweb_q08/datafusion:parquet 1952691083 2423902917 0.81
duckdb / vortex-file-compressed (1.009x ➖, 0↑ 1↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 79646316 84719601 0.94
fineweb_q01/duckdb:vortex-file-compressed 562678108 553642321 1.02
fineweb_q02/duckdb:vortex-file-compressed 🚨 647031304 446987175 1.45
fineweb_q03/duckdb:vortex-file-compressed 1502074128 1638280468 0.92
fineweb_q04/duckdb:vortex-file-compressed 1773883630 1574910534 1.13
fineweb_q05/duckdb:vortex-file-compressed 1455407733 1507943837 0.97
fineweb_q06/duckdb:vortex-file-compressed 1697232554 1710623736 0.99
fineweb_q07/duckdb:vortex-file-compressed 1467326955 1519937483 0.97
fineweb_q08/duckdb:vortex-file-compressed 603162207 737749030 0.82
duckdb / vortex-compact (0.890x ➖, 1↑ 0↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 84068701 104607227 0.80
fineweb_q01/duckdb:vortex-compact 592296939 724913830 0.82
fineweb_q02/duckdb:vortex-compact 604463818 664662807 0.91
fineweb_q03/duckdb:vortex-compact 1623575819 1651537706 0.98
fineweb_q04/duckdb:vortex-compact 1718742103 1744536427 0.99
fineweb_q05/duckdb:vortex-compact 1585616536 1476699971 1.07
fineweb_q06/duckdb:vortex-compact 1459090336 1613091120 0.90
fineweb_q07/duckdb:vortex-compact 1322729570 1459783849 0.91
fineweb_q08/duckdb:vortex-compact 🚀 485572673 706677486 0.69
duckdb / parquet (0.989x ➖, 0↑ 0↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1279068680 1132857141 1.13
fineweb_q01/duckdb:parquet 1717401214 1666219523 1.03
fineweb_q02/duckdb:parquet 1715656458 1718140216 1.00
fineweb_q03/duckdb:parquet 3977506515 4234568628 0.94
fineweb_q04/duckdb:parquet 1909310061 2203183674 0.87
fineweb_q05/duckdb:parquet 2671634858 2620223724 1.02
fineweb_q06/duckdb:parquet 3535844117 3491201784 1.01
fineweb_q07/duckdb:parquet 4210636630 4319089251 0.97
fineweb_q08/duckdb:parquet 1113543148 1174039770 0.95
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +34.4% +27.4% +5.5% +172.8% ➖ noise
0 datafusion:vortex-file-compressed -36.7% +27.4% -50.3% +149.9% ➖ noise
0 duckdb:vortex-compact -19.6% +27.4% -36.9% +93.2% ➖ noise
0 duckdb:vortex-file-compressed -6.0% +27.4% -26.2% +40.9% ➖ noise
1 datafusion:vortex-compact +22.1% -3.0% +25.9% +56.9% ➖ noise
1 datafusion:vortex-file-compressed +15.4% -3.0% +19.0% +65.1% ➖ noise
1 duckdb:vortex-compact -18.3% -3.0% -15.7% +35.8% ➖ noise
1 duckdb:vortex-file-compressed +1.6% -3.0% +4.8% +60.7% ➖ noise
2 datafusion:vortex-compact +21.6% +2.9% +18.1% +35.8% ➖ noise
2 datafusion:vortex-file-compressed -8.7% +2.9% -11.3% +40.0% ➖ noise
2 duckdb:vortex-compact -9.1% +2.9% -11.6% +35.8% ➖ noise
2 duckdb:vortex-file-compressed +44.8% +2.9% +40.6% +35.8% 🚨 regression
3 datafusion:vortex-compact -3.4% -3.1% -0.3% +35.8% ➖ noise
3 datafusion:vortex-file-compressed +11.3% -3.1% +14.8% +35.8% ➖ noise
3 duckdb:vortex-compact -1.7% -3.1% +1.4% +35.8% ➖ noise
3 duckdb:vortex-file-compressed -8.3% -3.1% -5.4% +35.8% ➖ noise
4 datafusion:vortex-compact -1.7% -14.5% +14.9% +35.8% ➖ noise
4 datafusion:vortex-file-compressed -0.8% -14.5% +16.0% +35.8% ➖ noise
4 duckdb:vortex-compact -1.5% -14.5% +15.2% +35.8% ➖ noise
4 duckdb:vortex-file-compressed +12.6% -14.5% +31.7% +35.8% ➖ noise
5 datafusion:vortex-compact -3.2% -6.0% +3.0% +35.8% ➖ noise
5 datafusion:vortex-file-compressed -0.7% -6.0% +5.6% +35.8% ➖ noise
5 duckdb:vortex-compact +7.4% -6.0% +14.3% +35.8% ➖ noise
5 duckdb:vortex-file-compressed -3.5% -6.0% +2.7% +35.8% ➖ noise
6 datafusion:vortex-compact -0.6% -8.5% +8.6% +35.8% ➖ noise
6 datafusion:vortex-file-compressed -4.5% -8.5% +4.3% +35.8% ➖ noise
6 duckdb:vortex-compact -9.5% -8.5% -1.2% +35.8% ➖ noise
6 duckdb:vortex-file-compressed -0.8% -8.5% +8.4% +35.8% ➖ noise
7 datafusion:vortex-compact -1.5% +4.0% -5.3% +35.8% ➖ noise
7 datafusion:vortex-file-compressed -2.2% +4.0% -6.0% +35.8% ➖ noise
7 duckdb:vortex-compact -9.4% +4.0% -12.9% +35.8% ➖ noise
7 duckdb:vortex-file-compressed -3.5% +4.0% -7.2% +35.8% ➖ noise
8 datafusion:vortex-compact -0.7% -12.6% +13.6% +41.2% ➖ noise
8 datafusion:vortex-file-compressed -12.8% -12.6% -0.2% +35.8% ➖ noise
8 duckdb:vortex-compact -31.3% -12.6% -21.4% +36.3% ➖ noise
8 duckdb:vortex-file-compressed -18.2% -12.6% -6.5% +35.8% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 2, 2026

Benchmarks: Random Access

Vortex (geomean): 0.901x ➖
Parquet (geomean): 1.042x ➖

unknown / unknown (0.990x ➖, 7↑ 8↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚨 2792634 2439038 1.14
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1327708 1325422 1.00
random-access/feature-vectors/correlated/parquet-tokio-local-disk 11724743471 12048228454 0.97
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 11263070361 11529450310 0.98
random-access/feature-vectors/correlated/vortex-tokio-local-disk 8075250 8631689 0.94
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 6176023 6776123 0.91
random-access/feature-vectors/uniform/lance-tokio-local-disk 1475795 1495089 0.99
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 2408145 2421870 0.99
random-access/feature-vectors/uniform/parquet-tokio-local-disk 11200901148 11485720018 0.98
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 11174243898 11260178429 0.99
random-access/feature-vectors/uniform/vortex-tokio-local-disk 13063568 14429977 0.91
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 13228595 14608817 0.91
random-access/lance-tokio-local-disk 740626 745369 0.99
random-access/lance-tokio-local-disk-footer 1344700 1360414 0.99
random-access/nested-lists/correlated/lance-tokio-local-disk 281740 271934 1.04
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 🚨 818119 728850 1.12
random-access/nested-lists/correlated/parquet-tokio-local-disk 141883063 140132254 1.01
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 138798775 138094219 1.01
random-access/nested-lists/correlated/vortex-tokio-local-disk 773388 706454 1.09
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 🚀 779226 916191 0.85
random-access/nested-lists/uniform/lance-tokio-local-disk 1268162 1185930 1.07
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1816624 1683240 1.08
random-access/nested-lists/uniform/parquet-tokio-local-disk 138981898 136602013 1.02
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 140558146 136578945 1.03
random-access/nested-lists/uniform/vortex-tokio-local-disk 2581655 2402732 1.07
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2586300 2517723 1.03
random-access/nested-structs/correlated/lance-tokio-local-disk 464765 438435 1.06
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 713782 653219 1.09
random-access/nested-structs/correlated/parquet-tokio-local-disk 🚨 30512122 26146958 1.17
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 🚨 30297430 26186723 1.16
random-access/nested-structs/correlated/vortex-tokio-local-disk 🚨 971230 877234 1.11
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 963725 911405 1.06
random-access/nested-structs/uniform/lance-tokio-local-disk 3100900 2893085 1.07
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 3333671 3140485 1.06
random-access/nested-structs/uniform/parquet-tokio-local-disk 🚨 30467185 26258054 1.16
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 🚨 30225453 25287273 1.20
random-access/nested-structs/uniform/vortex-tokio-local-disk 🚨 2027540 1784277 1.14
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 2010032 1831836 1.10
random-access/parquet-tokio-local-disk 187270092 183237884 1.02
random-access/parquet-tokio-local-disk-footer 186205204 182031183 1.02
random-access/taxi/correlated/lance-tokio-local-disk 965103 971580 0.99
random-access/taxi/correlated/lance-tokio-local-disk-footer 1646120 1670948 0.99
random-access/taxi/correlated/parquet-tokio-local-disk 275923961 270846607 1.02
random-access/taxi/correlated/parquet-tokio-local-disk-footer 276791930 269135738 1.03
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1722880 2433507 0.71
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚀 1729825 2521127 0.69
random-access/taxi/uniform/lance-tokio-local-disk 8534892 8652558 0.99
random-access/taxi/uniform/lance-tokio-local-disk-footer 9217565 9376982 0.98
random-access/taxi/uniform/parquet-tokio-local-disk 292406815 286183584 1.02
random-access/taxi/uniform/parquet-tokio-local-disk-footer 294939377 291104056 1.01
random-access/taxi/uniform/vortex-tokio-local-disk 🚀 4429327 5556389 0.80
random-access/taxi/uniform/vortex-tokio-local-disk-footer 🚀 4471346 5566332 0.80
random-access/vortex-tokio-local-disk 🚀 1245906 1814214 0.69
random-access/vortex-tokio-local-disk-footer 🚀 1260221 1838549 0.69

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 2, 2026

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.0%
Vortex (geomean): 0.968x ➖
Parquet (geomean): 0.988x ➖
Shifts: Parquet (control) -1.2% · Median polish -1.4%

duckdb / vortex-file-compressed (0.951x ➖, 1↑ 0↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 10692459 10877760 0.98
statpopgen_q01/duckdb:vortex-file-compressed 🚀 19053480 26469100 0.72
statpopgen_q02/duckdb:vortex-file-compressed 1303005206 1296908838 1.00
statpopgen_q03/duckdb:vortex-file-compressed 2960789009 3084968419 0.96
statpopgen_q04/duckdb:vortex-file-compressed 3047815282 3077639449 0.99
statpopgen_q05/duckdb:vortex-file-compressed 1404391190 1403576501 1.00
statpopgen_q06/duckdb:vortex-file-compressed 2057743128 2060418600 1.00
statpopgen_q07/duckdb:vortex-file-compressed 240342235 260851990 0.92
statpopgen_q08/duckdb:vortex-file-compressed 260667686 273274703 0.95
statpopgen_q09/duckdb:vortex-file-compressed 2746330006 2799417919 0.98
statpopgen_q10/duckdb:vortex-file-compressed 4568150663 4617199271 0.99
duckdb / vortex-compact (0.986x ➖, 0↑ 0↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 10740247 10952550 0.98
statpopgen_q01/duckdb:vortex-compact 164332184 170613320 0.96
statpopgen_q02/duckdb:vortex-compact 1803030493 1825221069 0.99
statpopgen_q03/duckdb:vortex-compact 3445792407 3462671259 1.00
statpopgen_q04/duckdb:vortex-compact 3491632917 3489286951 1.00
statpopgen_q05/duckdb:vortex-compact 1831629997 1864392800 0.98
statpopgen_q06/duckdb:vortex-compact 2663942532 2664510820 1.00
statpopgen_q07/duckdb:vortex-compact 957143365 981083617 0.98
statpopgen_q08/duckdb:vortex-compact 1007185011 1013980039 0.99
statpopgen_q09/duckdb:vortex-compact 3262988473 3334938967 0.98
statpopgen_q10/duckdb:vortex-compact 5375492186 5439881402 0.99
duckdb / parquet (0.988x ➖, 0↑ 0↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 308686164 317336902 0.97
statpopgen_q01/duckdb:parquet 395384689 400084399 0.99
statpopgen_q02/duckdb:parquet 996225188 1015456269 0.98
statpopgen_q03/duckdb:parquet 1484628782 1527863612 0.97
statpopgen_q04/duckdb:parquet 1527022373 1516312386 1.01
statpopgen_q05/duckdb:parquet 999790124 1014308381 0.99
statpopgen_q06/duckdb:parquet 1473342810 1494581198 0.99
statpopgen_q07/duckdb:parquet 1873532110 1873714024 1.00
statpopgen_q08/duckdb:parquet 1886355117 1887804504 1.00
statpopgen_q09/duckdb:parquet 1387933711 1399648551 0.99
statpopgen_q10/duckdb:parquet 2668004372 2706949598 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact -1.9% -2.7% +0.8% +10.0% ➖ noise
0 duckdb:vortex-file-compressed -1.7% -2.7% +1.1% +10.0% ➖ noise
1 duckdb:vortex-compact -3.7% -1.2% -2.5% +10.0% ➖ noise
1 duckdb:vortex-file-compressed -28.0% -1.2% -27.2% +211.2% ➖ noise
2 duckdb:vortex-compact -1.2% -1.9% +0.7% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +0.5% -1.9% +2.4% +10.0% ➖ noise
3 duckdb:vortex-compact -0.5% -2.8% +2.4% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -4.0% -2.8% -1.2% +10.0% ➖ noise
4 duckdb:vortex-compact +0.1% +0.7% -0.6% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -1.0% +0.7% -1.7% +10.0% ➖ noise
5 duckdb:vortex-compact -1.8% -1.4% -0.3% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +0.1% -1.4% +1.5% +10.0% ➖ noise
6 duckdb:vortex-compact -0.0% -1.4% +1.4% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -0.1% -1.4% +1.3% +10.0% ➖ noise
7 duckdb:vortex-compact -2.4% -0.0% -2.4% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -7.9% -0.0% -7.9% +10.0% ➖ noise
8 duckdb:vortex-compact -0.7% -0.1% -0.6% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -4.6% -0.1% -4.5% +10.0% ➖ noise
9 duckdb:vortex-compact -2.2% -0.8% -1.3% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -1.9% -0.8% -1.1% +10.0% ➖ noise
10 duckdb:vortex-compact -1.2% -1.4% +0.3% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -1.1% -1.4% +0.4% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 2, 2026

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.1%
Vortex (geomean): 0.995x ➖
Parquet (geomean): 0.995x ➖
Shifts: Parquet (control) -0.5% · Median polish -0.7%

datafusion / vortex-file-compressed (0.982x ➖, 1↑ 1↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1950529 1909716 1.02
clickbench_q01/datafusion:vortex-file-compressed 14395842 13551722 1.06
clickbench_q02/datafusion:vortex-file-compressed 35619858 36559029 0.97
clickbench_q03/datafusion:vortex-file-compressed 37940898 38401366 0.99
clickbench_q04/datafusion:vortex-file-compressed 308015989 314202522 0.98
clickbench_q05/datafusion:vortex-file-compressed 324263390 328767666 0.99
clickbench_q06/datafusion:vortex-file-compressed 1897015 2020907 0.94
clickbench_q07/datafusion:vortex-file-compressed 17508987 18008268 0.97
clickbench_q08/datafusion:vortex-file-compressed 375958999 385865166 0.97
clickbench_q09/datafusion:vortex-file-compressed 557219908 558701087 1.00
clickbench_q10/datafusion:vortex-file-compressed 78394547 77078813 1.02
clickbench_q11/datafusion:vortex-file-compressed 84485012 87557992 0.96
clickbench_q12/datafusion:vortex-file-compressed 275412511 286840224 0.96
clickbench_q13/datafusion:vortex-file-compressed 422326961 436514013 0.97
clickbench_q14/datafusion:vortex-file-compressed 254402493 263813559 0.96
clickbench_q15/datafusion:vortex-file-compressed 365873803 370659677 0.99
clickbench_q16/datafusion:vortex-file-compressed 697725259 710015535 0.98
clickbench_q17/datafusion:vortex-file-compressed 685158858 701913484 0.98
clickbench_q18/datafusion:vortex-file-compressed 1400684173 1486184406 0.94
clickbench_q19/datafusion:vortex-file-compressed 23593254 24925661 0.95
clickbench_q20/datafusion:vortex-file-compressed 352052814 359892632 0.98
clickbench_q21/datafusion:vortex-file-compressed 415739836 420439265 0.99
clickbench_q22/datafusion:vortex-file-compressed 495719871 523026868 0.95
clickbench_q23/datafusion:vortex-file-compressed 🚨 943663533 842384673 1.12
clickbench_q24/datafusion:vortex-file-compressed 46763549 46077348 1.01
clickbench_q25/datafusion:vortex-file-compressed 68346915 71205638 0.96
clickbench_q26/datafusion:vortex-file-compressed 45461016 49193658 0.92
clickbench_q27/datafusion:vortex-file-compressed 803412898 811665425 0.99
clickbench_q28/datafusion:vortex-file-compressed 6832660664 6912677224 0.99
clickbench_q29/datafusion:vortex-file-compressed 236187767 241023311 0.98
clickbench_q30/datafusion:vortex-file-compressed 235202543 236485588 0.99
clickbench_q31/datafusion:vortex-file-compressed 270902171 271513009 1.00
clickbench_q32/datafusion:vortex-file-compressed 🚀 1214665293 1384699813 0.88
clickbench_q33/datafusion:vortex-file-compressed 1431124742 1461262783 0.98
clickbench_q34/datafusion:vortex-file-compressed 1418172530 1454082618 0.98
clickbench_q35/datafusion:vortex-file-compressed 507640735 513391816 0.99
clickbench_q36/datafusion:vortex-file-compressed 79992605 79524366 1.01
clickbench_q37/datafusion:vortex-file-compressed 39591539 39990401 0.99
clickbench_q38/datafusion:vortex-file-compressed 23385891 23927506 0.98
clickbench_q39/datafusion:vortex-file-compressed 148499265 154764848 0.96
clickbench_q40/datafusion:vortex-file-compressed 19138710 18558194 1.03
clickbench_q41/datafusion:vortex-file-compressed 17538541 18325537 0.96
clickbench_q42/datafusion:vortex-file-compressed 19490698 19047005 1.02
datafusion / parquet (0.991x ➖, 0↑ 0↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1808201 1781710 1.01
clickbench_q01/datafusion:parquet 21347542 20428225 1.05
clickbench_q02/datafusion:parquet 56545183 56178695 1.01
clickbench_q03/datafusion:parquet 43832322 44992853 0.97
clickbench_q04/datafusion:parquet 336050780 345711485 0.97
clickbench_q05/datafusion:parquet 368214625 368037524 1.00
clickbench_q06/datafusion:parquet 1770669 1774449 1.00
clickbench_q07/datafusion:parquet 25761781 25233768 1.02
clickbench_q08/datafusion:parquet 401708958 411670102 0.98
clickbench_q09/datafusion:parquet 642960764 644028819 1.00
clickbench_q10/datafusion:parquet 109667499 111985901 0.98
clickbench_q11/datafusion:parquet 132059613 139103487 0.95
clickbench_q12/datafusion:parquet 362262119 370916322 0.98
clickbench_q13/datafusion:parquet 506640891 519724802 0.97
clickbench_q14/datafusion:parquet 360470814 371326342 0.97
clickbench_q15/datafusion:parquet 382374614 390151338 0.98
clickbench_q16/datafusion:parquet 693424960 711632470 0.97
clickbench_q17/datafusion:parquet 689326718 703690913 0.98
clickbench_q18/datafusion:parquet 1443050675 1465023836 0.99
clickbench_q19/datafusion:parquet 33311125 33523436 0.99
clickbench_q20/datafusion:parquet 612961591 625293629 0.98
clickbench_q21/datafusion:parquet 661189107 679699738 0.97
clickbench_q22/datafusion:parquet 963700090 952926300 1.01
clickbench_q23/datafusion:parquet 3598807615 3631998497 0.99
clickbench_q24/datafusion:parquet 89002931 84486743 1.05
clickbench_q25/datafusion:parquet 138151013 142444110 0.97
clickbench_q26/datafusion:parquet 83828333 88855588 0.94
clickbench_q27/datafusion:parquet 1041296347 1029823197 1.01
clickbench_q28/datafusion:parquet 6656607412 6609030577 1.01
clickbench_q29/datafusion:parquet 239210414 242416463 0.99
clickbench_q30/datafusion:parquet 356498083 364361964 0.98
clickbench_q31/datafusion:parquet 386964306 392714290 0.99
clickbench_q32/datafusion:parquet 1279509412 1305818332 0.98
clickbench_q33/datafusion:parquet 1544005149 1573205099 0.98
clickbench_q34/datafusion:parquet 1545067102 1543002047 1.00
clickbench_q35/datafusion:parquet 529104141 537323165 0.98
clickbench_q36/datafusion:parquet 153469327 141761641 1.08
clickbench_q37/datafusion:parquet 61903343 60770171 1.02
clickbench_q38/datafusion:parquet 89457136 89708440 1.00
clickbench_q39/datafusion:parquet 270106956 275988705 0.98
clickbench_q40/datafusion:parquet 33053369 34038973 0.97
clickbench_q41/datafusion:parquet 30529938 31310863 0.98
clickbench_q42/datafusion:parquet 31706725 32210474 0.98
duckdb / vortex-file-compressed (1.009x ➖, 3↑ 4↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 6243834 6292677 0.99
clickbench_q01/duckdb:vortex-file-compressed 13734206 13754266 1.00
clickbench_q02/duckdb:vortex-file-compressed 25736985 25777631 1.00
clickbench_q03/duckdb:vortex-file-compressed 29639613 30194266 0.98
clickbench_q04/duckdb:vortex-file-compressed 176642142 169666762 1.04
clickbench_q05/duckdb:vortex-file-compressed 195786468 197074279 0.99
clickbench_q06/duckdb:vortex-file-compressed 17817647 18989133 0.94
clickbench_q07/duckdb:vortex-file-compressed 15531585 15073698 1.03
clickbench_q08/duckdb:vortex-file-compressed 262636417 266378224 0.99
clickbench_q09/duckdb:vortex-file-compressed 379779085 378753911 1.00
clickbench_q10/duckdb:vortex-file-compressed 75872003 76276317 0.99
clickbench_q11/duckdb:vortex-file-compressed 86176699 85828662 1.00
clickbench_q12/duckdb:vortex-file-compressed 218607879 216578897 1.01
clickbench_q13/duckdb:vortex-file-compressed 446363264 428931019 1.04
clickbench_q14/duckdb:vortex-file-compressed 242476712 241077660 1.01
clickbench_q15/duckdb:vortex-file-compressed 213243060 213517154 1.00
clickbench_q16/duckdb:vortex-file-compressed 743923282 684687767 1.09
clickbench_q17/duckdb:vortex-file-compressed 563282267 530500399 1.06
clickbench_q18/duckdb:vortex-file-compressed 1240822132 1196758153 1.04
clickbench_q19/duckdb:vortex-file-compressed 21333798 21223678 1.01
clickbench_q20/duckdb:vortex-file-compressed 🚨 425904038 379565628 1.12
clickbench_q21/duckdb:vortex-file-compressed 427967875 410620175 1.04
clickbench_q22/duckdb:vortex-file-compressed 631049079 649956934 0.97
clickbench_q23/duckdb:vortex-file-compressed 🚨 1014483120 750867117 1.35
clickbench_q24/duckdb:vortex-file-compressed 48378842 51573100 0.94
clickbench_q25/duckdb:vortex-file-compressed 81267840 75771872 1.07
clickbench_q26/duckdb:vortex-file-compressed 48732133 44424334 1.10
clickbench_q27/duckdb:vortex-file-compressed 516116016 503393217 1.03
clickbench_q28/duckdb:vortex-file-compressed 3010363443 3002662801 1.00
clickbench_q29/duckdb:vortex-file-compressed 28057417 28468223 0.99
clickbench_q30/duckdb:vortex-file-compressed 184217070 183825634 1.00
clickbench_q31/duckdb:vortex-file-compressed 263223989 262810471 1.00
clickbench_q32/duckdb:vortex-file-compressed 1296057178 1359948119 0.95
clickbench_q33/duckdb:vortex-file-compressed 🚨 1827719677 1430959557 1.28
clickbench_q34/duckdb:vortex-file-compressed 🚨 1945945354 1544410494 1.26
clickbench_q35/duckdb:vortex-file-compressed 361846465 369147122 0.98
clickbench_q36/duckdb:vortex-file-compressed 🚀 28877169 32384530 0.89
clickbench_q37/duckdb:vortex-file-compressed 🚀 20256940 24068528 0.84
clickbench_q38/duckdb:vortex-file-compressed 24074499 26031381 0.92
clickbench_q39/duckdb:vortex-file-compressed 45149804 45204329 1.00
clickbench_q40/duckdb:vortex-file-compressed 20536830 22698434 0.90
clickbench_q41/duckdb:vortex-file-compressed 20983357 21546341 0.97
clickbench_q42/duckdb:vortex-file-compressed 🚀 19929621 25905293 0.77
duckdb / parquet (1.000x ➖, 0↑ 0↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 217983635 224683774 0.97
clickbench_q01/duckdb:parquet 51152615 51268760 1.00
clickbench_q02/duckdb:parquet 65977822 65963030 1.00
clickbench_q03/duckdb:parquet 64112912 64090901 1.00
clickbench_q04/duckdb:parquet 206029840 206228953 1.00
clickbench_q05/duckdb:parquet 283976665 281541566 1.01
clickbench_q06/duckdb:parquet 60230578 61053262 0.99
clickbench_q07/duckdb:parquet 53092524 53534560 0.99
clickbench_q08/duckdb:parquet 271578018 268887338 1.01
clickbench_q09/duckdb:parquet 398902970 398981588 1.00
clickbench_q10/duckdb:parquet 95160822 94671037 1.01
clickbench_q11/duckdb:parquet 106661282 107602402 0.99
clickbench_q12/duckdb:parquet 297747737 302580447 0.98
clickbench_q13/duckdb:parquet 517910586 523275102 0.99
clickbench_q14/duckdb:parquet 331660363 325378804 1.02
clickbench_q15/duckdb:parquet 244150177 243652548 1.00
clickbench_q16/duckdb:parquet 613342340 617940436 0.99
clickbench_q17/duckdb:parquet 516095776 513467333 1.01
clickbench_q18/duckdb:parquet 1046885290 1064858093 0.98
clickbench_q19/duckdb:parquet 49512396 49784333 0.99
clickbench_q20/duckdb:parquet 436185259 432518196 1.01
clickbench_q21/duckdb:parquet 558165613 566706654 0.98
clickbench_q22/duckdb:parquet 941721224 925973607 1.02
clickbench_q23/duckdb:parquet 319357787 317127175 1.01
clickbench_q24/duckdb:parquet 80299805 78517173 1.02
clickbench_q25/duckdb:parquet 141799123 140592417 1.01
clickbench_q26/duckdb:parquet 55913669 52189940 1.07
clickbench_q27/duckdb:parquet 641065754 645892350 0.99
clickbench_q28/duckdb:parquet 4853732168 4856333645 1.00
clickbench_q29/duckdb:parquet 60597264 61802550 0.98
clickbench_q30/duckdb:parquet 306103820 307342661 1.00
clickbench_q31/duckdb:parquet 347034969 350308508 0.99
clickbench_q32/duckdb:parquet 1174513953 1151703576 1.02
clickbench_q33/duckdb:parquet 1245108285 1249160357 1.00
clickbench_q34/duckdb:parquet 1301804103 1261249054 1.03
clickbench_q35/duckdb:parquet 354186102 353334455 1.00
clickbench_q36/duckdb:parquet 63411139 65566914 0.97
clickbench_q37/duckdb:parquet 54149330 54615453 0.99
clickbench_q38/duckdb:parquet 59011826 59704685 0.99
clickbench_q39/duckdb:parquet 96893471 101163130 0.96
clickbench_q40/duckdb:parquet 55551081 55917412 0.99
clickbench_q41/duckdb:parquet 58645325 59366956 0.99
clickbench_q42/duckdb:parquet 53086480 50030340 1.06
duckdb / duckdb (0.997x ➖, 0↑ 1↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 17795391 17452258 1.02
clickbench_q01/duckdb:duckdb 33242812 33294779 1.00
clickbench_q02/duckdb:duckdb 46740124 45311467 1.03
clickbench_q03/duckdb:duckdb 47436629 47111411 1.01
clickbench_q04/duckdb:duckdb 218928293 213292605 1.03
clickbench_q05/duckdb:duckdb 322947158 330417831 0.98
clickbench_q06/duckdb:duckdb 35441163 35305874 1.00
clickbench_q07/duckdb:duckdb 35745064 35083628 1.02
clickbench_q08/duckdb:duckdb 305165327 316098914 0.97
clickbench_q09/duckdb:duckdb 481483067 498692155 0.97
clickbench_q10/duckdb:duckdb 97430975 100233227 0.97
clickbench_q11/duckdb:duckdb 106839905 107484801 0.99
clickbench_q12/duckdb:duckdb 306302498 312489162 0.98
clickbench_q13/duckdb:duckdb 540307644 580951185 0.93
clickbench_q14/duckdb:duckdb 354093807 362066733 0.98
clickbench_q15/duckdb:duckdb 267237390 262231947 1.02
clickbench_q16/duckdb:duckdb 679233807 704376252 0.96
clickbench_q17/duckdb:duckdb 584877494 586327126 1.00
clickbench_q18/duckdb:duckdb 1295630184 1279736198 1.01
clickbench_q19/duckdb:duckdb 35057359 34402686 1.02
clickbench_q20/duckdb:duckdb 1018288006 1034613452 0.98
clickbench_q21/duckdb:duckdb 1110746437 1156079243 0.96
clickbench_q22/duckdb:duckdb 🚨 1144164998 1038800783 1.10
clickbench_q23/duckdb:duckdb 257531240 259817423 0.99
clickbench_q24/duckdb:duckdb 60700794 62644348 0.97
clickbench_q25/duckdb:duckdb 124189415 124639372 1.00
clickbench_q26/duckdb:duckdb 56562472 54850532 1.03
clickbench_q27/duckdb:duckdb 1087313339 1020425874 1.07
clickbench_q28/duckdb:duckdb 4661523798 4683902209 1.00
clickbench_q29/duckdb:duckdb 48088534 48751494 0.99
clickbench_q30/duckdb:duckdb 283558943 286278273 0.99
clickbench_q31/duckdb:duckdb 405219752 421463320 0.96
clickbench_q32/duckdb:duckdb 1489452780 1433999514 1.04
clickbench_q33/duckdb:duckdb 1939969438 2019004401 0.96
clickbench_q34/duckdb:duckdb 2031134102 2034668633 1.00
clickbench_q35/duckdb:duckdb 265452860 265910158 1.00
clickbench_q36/duckdb:duckdb 40566184 40987827 0.99
clickbench_q37/duckdb:duckdb 31400070 31585889 0.99
clickbench_q38/duckdb:duckdb 30413632 31091950 0.98
clickbench_q39/duckdb:duckdb 66176060 67017019 0.99
clickbench_q40/duckdb:duckdb 31620284 31001074 1.02
clickbench_q41/duckdb:duckdb 30327619 30365081 1.00
clickbench_q42/duckdb:duckdb 31615345 31636309 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +2.1% -0.8% +2.9% +636.7% ➖ noise
0 duckdb:duckdb +2.0% -0.8% +2.8% +259.0% ➖ noise
0 duckdb:vortex-file-compressed -0.8% -0.8% -0.0% +299.8% ➖ noise
1 datafusion:vortex-file-compressed +6.2% +2.1% +4.0% +44.9% ➖ noise
1 duckdb:duckdb -0.2% +2.1% -2.2% +52.2% ➖ noise
1 duckdb:vortex-file-compressed -0.1% +2.1% -2.2% +16.0% ➖ noise
2 datafusion:vortex-file-compressed -2.6% +0.3% -2.9% +33.8% ➖ noise
2 duckdb:duckdb +3.2% +0.3% +2.8% +21.3% ➖ noise
2 duckdb:vortex-file-compressed -0.2% +0.3% -0.5% +12.9% ➖ noise
3 datafusion:vortex-file-compressed -1.2% -1.3% +0.1% +162.7% ➖ noise
3 duckdb:duckdb +0.7% -1.3% +2.0% +50.0% ➖ noise
3 duckdb:vortex-file-compressed -1.8% -1.3% -0.6% +27.7% ➖ noise
4 datafusion:vortex-file-compressed -2.0% -1.5% -0.5% +10.0% ➖ noise
4 duckdb:duckdb +2.6% -1.5% +4.2% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +4.1% -1.5% +5.6% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -1.4% +0.5% -1.8% +10.0% ➖ noise
5 duckdb:duckdb -2.3% +0.5% -2.7% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -0.7% +0.5% -1.1% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -6.1% -0.8% -5.4% +42.4% ➖ noise
6 duckdb:duckdb +0.4% -0.8% +1.2% +28.9% ➖ noise
6 duckdb:vortex-file-compressed -6.2% -0.8% -5.4% +23.9% ➖ noise
7 datafusion:vortex-file-compressed -2.8% +0.6% -3.4% +15.7% ➖ noise
7 duckdb:duckdb +1.9% +0.6% +1.3% +11.5% ➖ noise
7 duckdb:vortex-file-compressed +3.0% +0.6% +2.4% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -2.6% -0.7% -1.9% +10.0% ➖ noise
8 duckdb:duckdb -3.5% -0.7% -2.8% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -1.4% -0.7% -0.7% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -0.3% -0.1% -0.2% +11.1% ➖ noise
9 duckdb:duckdb -3.5% -0.1% -3.4% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +0.3% -0.1% +0.4% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +1.7% -0.8% +2.5% +10.0% ➖ noise
10 duckdb:duckdb -2.8% -0.8% -2.0% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -0.5% -0.8% +0.3% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -3.5% -3.0% -0.5% +10.0% ➖ noise
11 duckdb:duckdb -0.6% -3.0% +2.5% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +0.4% -3.0% +3.5% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -4.0% -2.0% -2.1% +10.0% ➖ noise
12 duckdb:duckdb -2.0% -2.0% -0.0% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +0.9% -2.0% +3.0% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -3.3% -1.8% -1.5% +10.0% ➖ noise
13 duckdb:duckdb -7.0% -1.8% -5.3% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +4.1% -1.8% +5.9% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -3.6% -0.5% -3.1% +10.0% ➖ noise
14 duckdb:duckdb -2.2% -0.5% -1.7% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +0.6% -0.5% +1.1% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -1.3% -0.9% -0.4% +10.0% ➖ noise
15 duckdb:duckdb +1.9% -0.9% +2.8% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -0.1% -0.9% +0.8% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -1.7% -1.7% -0.1% +10.0% ➖ noise
16 duckdb:duckdb -3.6% -1.7% -1.9% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +8.7% -1.7% +10.5% +11.9% ➖ noise
17 datafusion:vortex-file-compressed -2.4% -0.8% -1.6% +10.0% ➖ noise
17 duckdb:duckdb -0.2% -0.8% +0.5% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +6.2% -0.8% +7.0% +14.5% ➖ noise
18 datafusion:vortex-file-compressed -5.8% -1.6% -4.2% +10.0% ➖ noise
18 duckdb:duckdb +1.2% -1.6% +2.9% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +3.7% -1.6% +5.4% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -5.3% -0.6% -4.8% +58.3% ➖ noise
19 duckdb:duckdb +1.9% -0.6% +2.5% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +0.5% -0.6% +1.1% +29.5% ➖ noise
20 datafusion:vortex-file-compressed -2.2% -0.6% -1.6% +192.3% ➖ noise
20 duckdb:duckdb -1.6% -0.6% -1.0% +21.6% ➖ noise
20 duckdb:vortex-file-compressed +12.2% -0.6% +12.9% +10.0% 🚨 regression
21 datafusion:vortex-file-compressed -1.1% -2.1% +1.0% +10.0% ➖ noise
21 duckdb:duckdb -3.9% -2.1% -1.8% +14.9% ➖ noise
21 duckdb:vortex-file-compressed +4.2% -2.1% +6.5% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -5.2% +1.4% -6.5% +10.0% ➖ noise
22 duckdb:duckdb +10.1% +1.4% +8.6% +16.7% ➖ noise
22 duckdb:vortex-file-compressed -2.9% +1.4% -4.3% +18.5% ➖ noise
23 datafusion:vortex-file-compressed +12.0% -0.1% +12.1% +34.6% ➖ noise
23 duckdb:duckdb -0.9% -0.1% -0.8% +10.0% ➖ noise
23 duckdb:vortex-file-compressed +35.1% -0.1% +35.3% +59.5% ➖ noise
24 datafusion:vortex-file-compressed +1.5% +3.8% -2.2% +11.9% ➖ noise
24 duckdb:duckdb -3.1% +3.8% -6.6% +10.0% ➖ noise
24 duckdb:vortex-file-compressed -6.2% +3.8% -9.6% +20.5% ➖ noise
25 datafusion:vortex-file-compressed -4.0% -1.1% -3.0% +10.1% ➖ noise
25 duckdb:duckdb -0.4% -1.1% +0.7% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +7.3% -1.1% +8.4% +12.7% ➖ noise
26 datafusion:vortex-file-compressed -7.6% +0.5% -8.1% +14.0% ➖ noise
26 duckdb:duckdb +3.1% +0.5% +2.6% +13.0% ➖ noise
26 duckdb:vortex-file-compressed +9.7% +0.5% +9.1% +15.8% ➖ noise
27 datafusion:vortex-file-compressed -1.0% +0.2% -1.2% +10.0% ➖ noise
27 duckdb:duckdb +6.6% +0.2% +6.4% +10.3% ➖ noise
27 duckdb:vortex-file-compressed +2.5% +0.2% +2.3% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -1.2% +0.3% -1.5% +10.0% ➖ noise
28 duckdb:duckdb -0.5% +0.3% -0.8% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +0.3% +0.3% -0.1% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -2.0% -1.6% -0.4% +12.5% ➖ noise
29 duckdb:duckdb -1.4% -1.6% +0.3% +10.0% ➖ noise
29 duckdb:vortex-file-compressed -1.4% -1.6% +0.2% +10.1% ➖ noise
30 datafusion:vortex-file-compressed -0.5% -1.3% +0.8% +10.0% ➖ noise
30 duckdb:duckdb -0.9% -1.3% +0.3% +10.0% ➖ noise
30 duckdb:vortex-file-compressed +0.2% -1.3% +1.5% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -0.2% -1.2% +1.0% +10.0% ➖ noise
31 duckdb:duckdb -3.9% -1.2% -2.7% +10.0% ➖ noise
31 duckdb:vortex-file-compressed +0.2% -1.2% +1.4% +10.0% ➖ noise
32 datafusion:vortex-file-compressed -12.3% -0.0% -12.2% +16.5% ➖ noise
32 duckdb:duckdb +3.9% -0.0% +3.9% +10.0% ➖ noise
32 duckdb:vortex-file-compressed -4.7% -0.0% -4.7% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -2.1% -1.1% -1.0% +10.0% ➖ noise
33 duckdb:duckdb -3.9% -1.1% -2.9% +10.0% ➖ noise
33 duckdb:vortex-file-compressed +27.7% -1.1% +29.1% +10.0% 🚨 regression
34 datafusion:vortex-file-compressed -2.5% +1.7% -4.1% +10.0% ➖ noise
34 duckdb:duckdb -0.2% +1.7% -1.8% +10.0% ➖ noise
34 duckdb:vortex-file-compressed +26.0% +1.7% +23.9% +10.0% 🚨 regression
35 datafusion:vortex-file-compressed -1.1% -0.6% -0.5% +10.0% ➖ noise
35 duckdb:duckdb -0.2% -0.6% +0.5% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -2.0% -0.6% -1.3% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +0.6% +2.3% -1.7% +10.0% ➖ noise
36 duckdb:duckdb -1.0% +2.3% -3.3% +10.0% ➖ noise
36 duckdb:vortex-file-compressed -10.8% +2.3% -12.9% +10.0% ✅ faster
37 datafusion:vortex-file-compressed -1.0% +0.5% -1.5% +10.0% ➖ noise
37 duckdb:duckdb -0.6% +0.5% -1.1% +10.0% ➖ noise
37 duckdb:vortex-file-compressed -15.8% +0.5% -16.3% +12.4% ✅ faster
38 datafusion:vortex-file-compressed -2.3% -0.7% -1.6% +10.0% ➖ noise
38 duckdb:duckdb -2.2% -0.7% -1.5% +10.0% ➖ noise
38 duckdb:vortex-file-compressed -7.5% -0.7% -6.8% +20.6% ➖ noise
39 datafusion:vortex-file-compressed -4.0% -3.2% -0.9% +10.0% ➖ noise
39 duckdb:duckdb -1.3% -3.2% +2.0% +20.9% ➖ noise
39 duckdb:vortex-file-compressed -0.1% -3.2% +3.2% +10.0% ➖ noise
40 datafusion:vortex-file-compressed +3.1% -1.8% +5.0% +10.0% ➖ noise
40 duckdb:duckdb +2.0% -1.8% +3.8% +10.0% ➖ noise
40 duckdb:vortex-file-compressed -9.5% -1.8% -7.9% +10.0% ➖ noise
41 datafusion:vortex-file-compressed -4.3% -1.9% -2.5% +10.0% ➖ noise
41 duckdb:duckdb -0.1% -1.9% +1.8% +10.0% ➖ noise
41 duckdb:vortex-file-compressed -2.6% -1.9% -0.8% +10.0% ➖ noise
42 datafusion:vortex-file-compressed +2.3% +2.2% +0.1% +10.0% ➖ noise
42 duckdb:duckdb -0.1% +2.2% -2.2% +10.0% ➖ noise
42 duckdb:vortex-file-compressed -23.1% +2.2% -24.7% +22.6% ✅ faster

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 2, 2026

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -0.1%
Vortex (geomean): 0.971x ➖
Parquet (geomean): 0.972x ➖
Shifts: Parquet (control) -2.8% · Median polish -3.2%

datafusion / vortex-file-compressed (0.966x ➖, 1↑ 1↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 709173019 745781666 0.95
tpch_q02/datafusion:vortex-file-compressed 831497717 845919803 0.98
tpch_q03/datafusion:vortex-file-compressed 🚀 800583473 1258860351 0.64
tpch_q04/datafusion:vortex-file-compressed 607578239 700358637 0.87
tpch_q05/datafusion:vortex-file-compressed 1020906041 1192641132 0.86
tpch_q06/datafusion:vortex-file-compressed 635012476 669731254 0.95
tpch_q07/datafusion:vortex-file-compressed 1065673402 1314777374 0.81
tpch_q08/datafusion:vortex-file-compressed 1495298168 1303718374 1.15
tpch_q09/datafusion:vortex-file-compressed 🚨 1900601245 1378745367 1.38
tpch_q10/datafusion:vortex-file-compressed 1143537828 954250592 1.20
tpch_q11/datafusion:vortex-file-compressed 547871293 478777974 1.14
tpch_q12/datafusion:vortex-file-compressed 895265879 1042114547 0.86
tpch_q13/datafusion:vortex-file-compressed 490553854 474341825 1.03
tpch_q14/datafusion:vortex-file-compressed 593448721 599276184 0.99
tpch_q15/datafusion:vortex-file-compressed 1033512539 1097774578 0.94
tpch_q16/datafusion:vortex-file-compressed 351950409 305938657 1.15
tpch_q17/datafusion:vortex-file-compressed 1185965473 1143691846 1.04
tpch_q18/datafusion:vortex-file-compressed 1245371873 1234503372 1.01
tpch_q19/datafusion:vortex-file-compressed 727104861 831263875 0.87
tpch_q20/datafusion:vortex-file-compressed 997625437 1086786222 0.92
tpch_q21/datafusion:vortex-file-compressed 1683906728 2087812979 0.81
tpch_q22/datafusion:vortex-file-compressed 398305366 405461897 0.98
datafusion / vortex-compact (0.897x ➖, 2↑ 0↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 753726326 869791036 0.87
tpch_q02/datafusion:vortex-compact 🚀 691857687 1299984467 0.53
tpch_q03/datafusion:vortex-compact 868102818 1069503928 0.81
tpch_q04/datafusion:vortex-compact 677104582 687601092 0.98
tpch_q05/datafusion:vortex-compact 1079151270 1408128439 0.77
tpch_q06/datafusion:vortex-compact 582180969 635999312 0.92
tpch_q07/datafusion:vortex-compact 1056514958 1481985266 0.71
tpch_q08/datafusion:vortex-compact 1216004905 1184300577 1.03
tpch_q09/datafusion:vortex-compact 1244111439 1367356227 0.91
tpch_q10/datafusion:vortex-compact 984698502 1215799490 0.81
tpch_q11/datafusion:vortex-compact 🚀 417498998 673343925 0.62
tpch_q12/datafusion:vortex-compact 878073383 1057606275 0.83
tpch_q13/datafusion:vortex-compact 500203888 415004745 1.21
tpch_q14/datafusion:vortex-compact 656900499 599729641 1.10
tpch_q15/datafusion:vortex-compact 1255763196 1188173156 1.06
tpch_q16/datafusion:vortex-compact 330130490 304402718 1.08
tpch_q17/datafusion:vortex-compact 1251263432 1208279872 1.04
tpch_q18/datafusion:vortex-compact 1154002011 1113360145 1.04
tpch_q19/datafusion:vortex-compact 800743879 755394892 1.06
tpch_q20/datafusion:vortex-compact 899530087 857549202 1.05
tpch_q21/datafusion:vortex-compact 1453922112 1493678249 0.97
tpch_q22/datafusion:vortex-compact 358198640 494213358 0.72
datafusion / parquet (1.021x ➖, 2↑ 3↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 899590823 838225914 1.07
tpch_q02/datafusion:parquet 889893377 1037480517 0.86
tpch_q03/datafusion:parquet 1064975505 1210095703 0.88
tpch_q04/datafusion:parquet 561362544 617776275 0.91
tpch_q05/datafusion:parquet 1230958038 1266922528 0.97
tpch_q06/datafusion:parquet 530064758 526212568 1.01
tpch_q07/datafusion:parquet 1390349990 1408042153 0.99
tpch_q08/datafusion:parquet 1767436343 1569827950 1.13
tpch_q09/datafusion:parquet 2079666739 1735178026 1.20
tpch_q10/datafusion:parquet 1967794143 1975686137 1.00
tpch_q11/datafusion:parquet 🚀 627737431 924115608 0.68
tpch_q12/datafusion:parquet 721189318 689386455 1.05
tpch_q13/datafusion:parquet 🚨 972190376 733077848 1.33
tpch_q14/datafusion:parquet 879271497 789632263 1.11
tpch_q15/datafusion:parquet 1270674068 1351244351 0.94
tpch_q16/datafusion:parquet 🚀 570520751 1065878976 0.54
tpch_q17/datafusion:parquet 1607852670 1510909580 1.06
tpch_q18/datafusion:parquet 1842475180 1878745389 0.98
tpch_q19/datafusion:parquet 1129029635 1107745846 1.02
tpch_q20/datafusion:parquet 🚨 1937376189 1349270313 1.44
tpch_q21/datafusion:parquet 2232600781 2038611251 1.10
tpch_q22/datafusion:parquet 🚨 1689109584 909433213 1.86
duckdb / vortex-file-compressed (1.024x ➖, 0↑ 0↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 696708004 615403174 1.13
tpch_q02/duckdb:vortex-file-compressed 1391053809 1258486991 1.11
tpch_q03/duckdb:vortex-file-compressed 948015095 970627626 0.98
tpch_q04/duckdb:vortex-file-compressed 676857263 632939746 1.07
tpch_q05/duckdb:vortex-file-compressed 1231204984 1115427589 1.10
tpch_q06/duckdb:vortex-file-compressed 900602486 813204732 1.11
tpch_q07/duckdb:vortex-file-compressed 1271375187 1285325117 0.99
tpch_q08/duckdb:vortex-file-compressed 1541129214 1515595440 1.02
tpch_q09/duckdb:vortex-file-compressed 1575517859 1506063410 1.05
tpch_q10/duckdb:vortex-file-compressed 1365098439 1114402109 1.22
tpch_q11/duckdb:vortex-file-compressed 560234808 702303182 0.80
tpch_q12/duckdb:vortex-file-compressed 886400688 825951860 1.07
tpch_q13/duckdb:vortex-file-compressed 1078378817 1089374871 0.99
tpch_q14/duckdb:vortex-file-compressed 871457846 897833494 0.97
tpch_q15/duckdb:vortex-file-compressed 596804549 624337598 0.96
tpch_q16/duckdb:vortex-file-compressed 613435100 531587561 1.15
tpch_q17/duckdb:vortex-file-compressed 1045226063 968457515 1.08
tpch_q18/duckdb:vortex-file-compressed 949800818 882544803 1.08
tpch_q19/duckdb:vortex-file-compressed 737146644 788940685 0.93
tpch_q20/duckdb:vortex-file-compressed 1293748986 1280910334 1.01
tpch_q21/duckdb:vortex-file-compressed 2082608227 2002040060 1.04
tpch_q22/duckdb:vortex-file-compressed 566299571 711701983 0.80
duckdb / vortex-compact (1.002x ➖, 0↑ 0↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 654750754 674394335 0.97
tpch_q02/duckdb:vortex-compact 1071668456 1033571019 1.04
tpch_q03/duckdb:vortex-compact 1054400470 913109167 1.15
tpch_q04/duckdb:vortex-compact 551227857 639795384 0.86
tpch_q05/duckdb:vortex-compact 1124998107 981299195 1.15
tpch_q06/duckdb:vortex-compact 909988953 728642105 1.25
tpch_q07/duckdb:vortex-compact 1070498957 1114674320 0.96
tpch_q08/duckdb:vortex-compact 1460684506 1484053347 0.98
tpch_q09/duckdb:vortex-compact 1381222829 1403880942 0.98
tpch_q10/duckdb:vortex-compact 1080569791 1260371540 0.86
tpch_q11/duckdb:vortex-compact 679019595 715172713 0.95
tpch_q12/duckdb:vortex-compact 707914150 690351527 1.03
tpch_q13/duckdb:vortex-compact 1017573065 973952312 1.04
tpch_q14/duckdb:vortex-compact 931380713 941605063 0.99
tpch_q15/duckdb:vortex-compact 580819581 585689515 0.99
tpch_q16/duckdb:vortex-compact 472360951 383674684 1.23
tpch_q17/duckdb:vortex-compact 1082433371 1035981649 1.04
tpch_q18/duckdb:vortex-compact 827703300 800309315 1.03
tpch_q19/duckdb:vortex-compact 759163674 782510028 0.97
tpch_q20/duckdb:vortex-compact 1179274599 1282706673 0.92
tpch_q21/duckdb:vortex-compact 1706007664 1812304040 0.94
tpch_q22/duckdb:vortex-compact 605138913 735963928 0.82
duckdb / parquet (0.926x ➖, 1↑ 0↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 978550997 1052939170 0.93
tpch_q02/duckdb:parquet 1479652132 1615708503 0.92
tpch_q03/duckdb:parquet 1636008569 2035532756 0.80
tpch_q04/duckdb:parquet 🚀 861729824 1264953941 0.68
tpch_q05/duckdb:parquet 2333924742 2364727612 0.99
tpch_q06/duckdb:parquet 940281286 987608584 0.95
tpch_q07/duckdb:parquet 1768117070 1780438315 0.99
tpch_q08/duckdb:parquet 2624915593 3029623999 0.87
tpch_q09/duckdb:parquet 2432515748 2520236210 0.97
tpch_q10/duckdb:parquet 3449909485 3756025645 0.92
tpch_q11/duckdb:parquet 992506882 1177271888 0.84
tpch_q12/duckdb:parquet 1223751246 1217412600 1.01
tpch_q13/duckdb:parquet 1176894878 1489387598 0.79
tpch_q14/duckdb:parquet 1329132460 1100619873 1.21
tpch_q15/duckdb:parquet 1230855202 1290890354 0.95
tpch_q16/duckdb:parquet 747672631 840710572 0.89
tpch_q17/duckdb:parquet 1654206925 1303547595 1.27
tpch_q18/duckdb:parquet 1451352739 1563209293 0.93
tpch_q19/duckdb:parquet 1555617442 1967319240 0.79
tpch_q20/duckdb:parquet 2031872749 2328507186 0.87
tpch_q21/duckdb:parquet 1953893013 2281504035 0.86
tpch_q22/duckdb:parquet 1216724507 1041079488 1.17
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -13.3% -0.1% -13.2% +74.0% ➖ noise
1 datafusion:vortex-file-compressed -4.9% -0.1% -4.8% +79.9% ➖ noise
1 duckdb:vortex-compact -2.9% -0.1% -2.8% +50.9% ➖ noise
1 duckdb:vortex-file-compressed +13.2% -0.1% +13.4% +50.9% ➖ noise
2 datafusion:vortex-compact -46.8% -11.4% -40.0% +71.5% ➖ noise
2 datafusion:vortex-file-compressed -1.7% -11.4% +10.9% +70.9% ➖ noise
2 duckdb:vortex-compact +3.7% -11.4% +17.0% +60.0% ➖ noise
2 duckdb:vortex-file-compressed +10.5% -11.4% +24.7% +55.1% ➖ noise
3 datafusion:vortex-compact -18.8% -15.9% -3.5% +81.0% ➖ noise
3 datafusion:vortex-file-compressed -36.4% -15.9% -24.4% +98.4% ➖ noise
3 duckdb:vortex-compact +15.5% -15.9% +37.3% +52.4% ➖ noise
3 duckdb:vortex-file-compressed -2.3% -15.9% +16.1% +57.8% ➖ noise
4 datafusion:vortex-compact -1.5% -21.3% +25.2% +50.9% ➖ noise
4 datafusion:vortex-file-compressed -13.2% -21.3% +10.3% +50.9% ➖ noise
4 duckdb:vortex-compact -13.8% -21.3% +9.5% +61.0% ➖ noise
4 duckdb:vortex-file-compressed +6.9% -21.3% +35.9% +50.9% ➖ noise
5 datafusion:vortex-compact -23.4% -2.1% -21.7% +50.9% ➖ noise
5 datafusion:vortex-file-compressed -14.4% -2.1% -12.6% +50.9% ➖ noise
5 duckdb:vortex-compact +14.6% -2.1% +17.1% +50.9% ➖ noise
5 duckdb:vortex-file-compressed +10.4% -2.1% +12.7% +50.9% ➖ noise
6 datafusion:vortex-compact -8.5% -2.1% -6.5% +50.9% ➖ noise
6 datafusion:vortex-file-compressed -5.2% -2.1% -3.2% +50.9% ➖ noise
6 duckdb:vortex-compact +24.9% -2.1% +27.5% +50.9% ➖ noise
6 duckdb:vortex-file-compressed +10.7% -2.1% +13.1% +50.9% ➖ noise
7 datafusion:vortex-compact -28.7% -1.0% -28.0% +50.9% ➖ noise
7 datafusion:vortex-file-compressed -18.9% -1.0% -18.1% +50.9% ➖ noise
7 duckdb:vortex-compact -4.0% -1.0% -3.0% +50.9% ➖ noise
7 duckdb:vortex-file-compressed -1.1% -1.0% -0.1% +50.9% ➖ noise
8 datafusion:vortex-compact +2.7% -1.2% +4.0% +50.9% ➖ noise
8 datafusion:vortex-file-compressed +14.7% -1.2% +16.1% +52.2% ➖ noise
8 duckdb:vortex-compact -1.6% -1.2% -0.3% +50.9% ➖ noise
8 duckdb:vortex-file-compressed +1.7% -1.2% +3.0% +50.9% ➖ noise
9 datafusion:vortex-compact -9.0% +7.6% -15.4% +50.9% ➖ noise
9 datafusion:vortex-file-compressed +37.9% +7.6% +28.2% +50.9% ➖ noise
9 duckdb:vortex-compact -1.6% +7.6% -8.5% +50.9% ➖ noise
9 duckdb:vortex-file-compressed +4.6% +7.6% -2.7% +50.9% ➖ noise
10 datafusion:vortex-compact -19.0% -4.4% -15.3% +50.9% ➖ noise
10 datafusion:vortex-file-compressed +19.8% -4.4% +25.3% +50.9% ➖ noise
10 duckdb:vortex-compact -14.3% -4.4% -10.4% +60.8% ➖ noise
10 duckdb:vortex-file-compressed +22.5% -4.4% +28.1% +50.9% ➖ noise
11 datafusion:vortex-compact -38.0% -24.3% -18.1% +50.9% ➖ noise
11 datafusion:vortex-file-compressed +14.4% -24.3% +51.2% +65.1% ➖ noise
11 duckdb:vortex-compact -5.1% -24.3% +25.5% +50.9% ➖ noise
11 duckdb:vortex-file-compressed -20.2% -24.3% +5.4% +50.9% ➖ noise
12 datafusion:vortex-compact -17.0% +2.5% -19.0% +66.4% ➖ noise
12 datafusion:vortex-file-compressed -14.1% +2.5% -16.2% +56.6% ➖ noise
12 duckdb:vortex-compact +2.5% +2.5% -0.0% +50.9% ➖ noise
12 duckdb:vortex-file-compressed +7.3% +2.5% +4.7% +56.8% ➖ noise
13 datafusion:vortex-compact +20.5% +2.4% +17.7% +74.5% ➖ noise
13 datafusion:vortex-file-compressed +3.4% +2.4% +1.0% +50.9% ➖ noise
13 duckdb:vortex-compact +4.5% +2.4% +2.1% +66.9% ➖ noise
13 duckdb:vortex-file-compressed -1.0% +2.4% -3.3% +74.8% ➖ noise
14 datafusion:vortex-compact +9.5% +16.0% -5.5% +50.9% ➖ noise
14 datafusion:vortex-file-compressed -1.0% +16.0% -14.6% +50.9% ➖ noise
14 duckdb:vortex-compact -1.1% +16.0% -14.7% +50.9% ➖ noise
14 duckdb:vortex-file-compressed -2.9% +16.0% -16.3% +50.9% ➖ noise
15 datafusion:vortex-compact +5.7% -5.3% +11.6% +50.9% ➖ noise
15 datafusion:vortex-file-compressed -5.9% -5.3% -0.6% +50.9% ➖ noise
15 duckdb:vortex-compact -0.8% -5.3% +4.7% +50.9% ➖ noise
15 duckdb:vortex-file-compressed -4.4% -5.3% +0.9% +50.9% ➖ noise
16 datafusion:vortex-compact +8.5% -31.0% +57.2% +58.4% ➖ noise
16 datafusion:vortex-file-compressed +15.0% -31.0% +66.7% +50.9% 🚨 regression
16 duckdb:vortex-compact +23.1% -31.0% +78.4% +50.9% 🚨 regression
16 duckdb:vortex-file-compressed +15.4% -31.0% +67.3% +50.9% 🚨 regression
17 datafusion:vortex-compact +3.6% +16.2% -10.9% +50.9% ➖ noise
17 datafusion:vortex-file-compressed +3.7% +16.2% -10.8% +50.9% ➖ noise
17 duckdb:vortex-compact +4.5% +16.2% -10.1% +50.9% ➖ noise
17 duckdb:vortex-file-compressed +7.9% +16.2% -7.1% +50.9% ➖ noise
18 datafusion:vortex-compact +3.7% -4.6% +8.6% +50.9% ➖ noise
18 datafusion:vortex-file-compressed +0.9% -4.6% +5.7% +50.9% ➖ noise
18 duckdb:vortex-compact +3.4% -4.6% +8.4% +50.9% ➖ noise
18 duckdb:vortex-file-compressed +7.6% -4.6% +12.8% +50.9% ➖ noise
19 datafusion:vortex-compact +6.0% -10.2% +18.1% +50.9% ➖ noise
19 datafusion:vortex-file-compressed -12.5% -10.2% -2.6% +50.9% ➖ noise
19 duckdb:vortex-compact -3.0% -10.2% +8.1% +50.9% ➖ noise
19 duckdb:vortex-file-compressed -6.6% -10.2% +4.1% +50.9% ➖ noise
20 datafusion:vortex-compact +4.9% +11.9% -6.3% +50.9% ➖ noise
20 datafusion:vortex-file-compressed -8.2% +11.9% -18.0% +50.9% ➖ noise
20 duckdb:vortex-compact -8.1% +11.9% -17.9% +50.9% ➖ noise
20 duckdb:vortex-file-compressed +1.0% +11.9% -9.8% +50.9% ➖ noise
21 datafusion:vortex-compact -2.7% -3.2% +0.5% +50.9% ➖ noise
21 datafusion:vortex-file-compressed -19.3% -3.2% -16.7% +50.9% ➖ noise
21 duckdb:vortex-compact -5.9% -3.2% -2.8% +50.9% ➖ noise
21 duckdb:vortex-file-compressed +4.0% -3.2% +7.4% +50.9% ➖ noise
22 datafusion:vortex-compact -27.5% +47.3% -50.8% +71.0% ✅ faster
22 datafusion:vortex-file-compressed -1.8% +47.3% -33.3% +50.9% ➖ noise
22 duckdb:vortex-compact -17.8% +47.3% -44.2% +55.2% ✅ faster
22 duckdb:vortex-file-compressed -20.4% +47.3% -46.0% +50.9% ✅ faster

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 2, 2026

Benchmarks: Compression

Vortex (geomean): 0.934x ➖
Parquet (geomean): 0.937x ➖

unknown / unknown (0.917x ➖, 21↑ 1↓)
name PR 31586f3 (ns) base 13937c0 (ns) ratio (PR/base)
compress time/Arade 1241265360 1279382725 0.97
compress time/Bimbo 7748708376 7926102066 0.98
compress time/CMSprovider 3131374996 3132080743 1.00
compress time/Euro2016 446923803 454466461 0.98
compress time/Food 405666163 431744798 0.94
compress time/HashTags 832695372 849455322 0.98
compress time/TPC-H l_comment canonical 1371560692 1430346557 0.96
compress time/TPC-H l_comment chunked 1391971232 1400312563 0.99
compress time/taxi 751381460 754953021 1.00
compress time/wide table cols=100 chunks=1 rows=1000 🚀 11153900 13286132 0.84
compress time/wide table cols=100 chunks=50 rows=1000 12069451 12940623 0.93
compress time/wide table cols=1000 chunks=1 rows=1000 🚀 121776917 139667957 0.87
compress time/wide table cols=1000 chunks=50 rows=1000 🚀 123417489 138695789 0.89
compress time/wide table cols=10000 chunks=1 rows=1000 1267490024 1348138509 0.94
compress time/wide table cols=10000 chunks=50 rows=1000 1289442881 1345296586 0.96
decompress time/Arade 30729802 29977450 1.03
decompress time/Bimbo 111540875 108138731 1.03
decompress time/CMSprovider 85533028 90165792 0.95
decompress time/Euro2016 21663102 22171421 0.98
decompress time/Food 8302550 8601600 0.97
decompress time/HashTags 91821322 92095880 1.00
decompress time/TPC-H l_comment canonical 44700290 45449627 0.98
decompress time/TPC-H l_comment chunked 44415949 43536942 1.02
decompress time/taxi 20215396 19713146 1.03
decompress time/wide table cols=100 chunks=1 rows=1000 🚀 2561220 2963086 0.86
decompress time/wide table cols=100 chunks=50 rows=1000 🚀 2510605 3027998 0.83
decompress time/wide table cols=1000 chunks=1 rows=1000 🚀 23734425 38427370 0.62
decompress time/wide table cols=1000 chunks=50 rows=1000 🚀 22940480 37600197 0.61
decompress time/wide table cols=10000 chunks=1 rows=1000 🚀 241652567 1537856957 0.16
decompress time/wide table cols=10000 chunks=50 rows=1000 🚀 239196965 1522423696 0.16
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 3060008946 3180319716 0.96
parquet_rs-zstd compress time/Bimbo 17453927157 18368872775 0.95
parquet_rs-zstd compress time/CMSprovider 7889630286 8060061037 0.98
parquet_rs-zstd compress time/Euro2016 1352453115 1434782840 0.94
parquet_rs-zstd compress time/Food 952296962 976000688 0.98
parquet_rs-zstd compress time/HashTags 2478883196 2571161070 0.96
parquet_rs-zstd compress time/TPC-H l_comment canonical 3106728104 3214622764 0.97
parquet_rs-zstd compress time/TPC-H l_comment chunked 3108767732 3279062912 0.95
parquet_rs-zstd compress time/taxi 1521904966 1602655008 0.95
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 🚀 6737789 8162678 0.83
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 🚀 6954498 8028783 0.87
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 🚀 91217201 102099237 0.89
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 🚀 91435725 101722870 0.90
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 959399892 1022270706 0.94
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 964636788 1027520905 0.94
parquet_rs-zstd decompress time/Arade 651400548 667500363 0.98
parquet_rs-zstd decompress time/Bimbo 1825763609 1785723919 1.02
parquet_rs-zstd decompress time/CMSprovider 1957908952 2048979053 0.96
parquet_rs-zstd decompress time/Euro2016 386642370 396838095 0.97
parquet_rs-zstd decompress time/Food 225935108 226833724 1.00
parquet_rs-zstd decompress time/HashTags 🚀 623861590 702284246 0.89
parquet_rs-zstd decompress time/TPC-H l_comment canonical 576967549 575105944 1.00
parquet_rs-zstd decompress time/TPC-H l_comment chunked 571540985 580636399 0.98
parquet_rs-zstd decompress time/taxi 251813500 252373841 1.00
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2681586 2948173 0.91
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2741757 2922561 0.94
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 🚀 32609859 36969639 0.88
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 🚀 32539259 37024111 0.88
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 379727546 396991901 0.96
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 377053553 394884651 0.95
vortex-file-compressed size/Arade 143600332 143600332 1.00
vortex-file-compressed size/Bimbo 510400068 510400068 1.00
vortex-file-compressed size/CMSprovider 448304012 448304012 1.00
vortex-file-compressed size/Euro2016 164458756 164457092 1.00
vortex-file-compressed size/Food 44206912 44206912 1.00
vortex-file-compressed size/HashTags 195864476 195864476 1.00
vortex-file-compressed size/TPC-H l_comment canonical 179481896 179481896 1.00
vortex-file-compressed size/TPC-H l_comment chunked 179481896 179481896 1.00
vortex-file-compressed size/taxi 51040172 51040172 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 884416 884416 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 884416 884416 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 8829616 8829616 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 8829616 8829616 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 88317616 88317616 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 88317616 88317616 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 1.01
vortex:parquet-zstd ratio compress time/Bimbo 0 0 1.03
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 1.02
vortex:parquet-zstd ratio compress time/Euro2016 0 0 1.04
vortex:parquet-zstd ratio compress time/Food 0 0 0.96
vortex:parquet-zstd ratio compress time/HashTags 0 0 1.02
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 0.99
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.05
vortex:parquet-zstd ratio compress time/taxi 0 0 1.05
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1 1 1.02
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1 1 1.08
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 0.98
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 0.99
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 1.00
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.02
vortex:parquet-zstd ratio decompress time/Arade 0 0 1.05
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 1.01
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 0.99
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 1.00
vortex:parquet-zstd ratio decompress time/Food 0 0 0.97
vortex:parquet-zstd ratio decompress time/HashTags 🚨 0 0 1.12
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 0.98
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 1.04
vortex:parquet-zstd ratio decompress time/taxi 0 0 1.03
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 1 0.95
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 🚀 0 1 0.88
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 🚀 0 1 0.70
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 🚀 0 1 0.69
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 🚀 0 3 0.16
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 🚀 0 3 0.16
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@joseph-isaacs
Copy link
Copy Markdown
Contributor

joseph-isaacs commented Apr 2, 2026

#7259

@onursatici onursatici closed this Apr 2, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

do not merge Pull requests that are not intended to merge

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@onursatici @joseph-isaacs